Labelbox has a separate interface and queue system for reviewing Labels. When you set up your team in Labelbox, you have the option to designate members of your team as Reviewers. Reviewers may approve or deny a Label, open an issue on a Label, and make modifications to the Label.
The review queue contains the percentage of submitted or skipped assets configured in the Review step for the project. The review queue abides by the following rules:
Only submitted or skipped assets can be entered into the review queue.
With additional configuration, an asset in the review queue may be reviewed by more than one user, but never twice by the same user.
Members with the Reviewer role will see these assets in a special review interface. Reviewers are able to modify the annotations and submit their reviews by approving or rejecting the labeled assets.
Enable the Review step by doing the following:
Select a project.
Go to the Settings tab.
Toggle on the Review step.
Set the Coverage and click Confirm changes.
Go to the Labels tab.
Click Review labels to enter review mode.
The Reviews section in the Project overview tab contains a simple metric for understanding the general trends in user reviews.
No reviews at all
Labels where the majority upvoted
Labels where the majority downvoted
Number of issues in the project (see [Issues & comments](doc: issues-comments)).
You can access the Label browser by clicking on any row in the Activity table (under the Labels tab). In the Label browser panel, you will see a list of all assets in your project and their review score. It presents a streamlined and transparent way to do the following:
Modify a review
Modify a label
Copy a label URL
See team progress
Updated about 2 months ago