Review step

Labelbox has a separate interface and queue system for reviewing Labels. When you set up your team in Labelbox, you have the option to designate members of your team as Reviewers. Reviewers may approve or deny a Label, open an issue on a Label, and make modifications to the Label.

The review queue contains the percentage of submitted or skipped assets configured in the Review step for the project. The review queue abides by the following rules:

  • Only submitted or skipped assets can be entered into the review queue.

  • With additional configuration, an asset in the review queue may be reviewed by more than one user, but never twice by the same user.

Members with the Reviewer role will see these assets in a special review interface. Reviewers are able to modify the annotations and submit their reviews by approving or rejecting the labeled assets.

How to enable the Review step

Enable the Review step by doing the following:

  1. Select a project.

  2. Go to the Settings tab.

  3. Click Quality.

  4. Toggle on the Review step.

  5. Set the Coverage and click Confirm changes.

  6. Go to the Labels tab.

  7. Click Review labels to enter review mode.

How to view Reviews

The Reviews section in the Project overview tab contains a simple metric for understanding the general trends in user reviews.

Metric

Description

Un-reviewed labels

No reviews at all

Accepted labels

Labels where the majority upvoted

Declined labels

Labels where the majority downvoted

Issue count

Number of issues in the project (see [Issues & comments](doc: issues-comments)).

How to open the Label browser

You can access the Label browser by clicking on any row in the Activity table (under the Labels tab). In the Label browser panel, you will see a list of all assets in your project and their review score. It presents a streamlined and transparent way to do the following:

  • Modify a review

  • Modify a label

  • Copy a label URL

  • See team progress


Did this page help you?