Labelbox has a separate interface and queue system for reviewing Labels. When you set up your team in Labelbox, you have the option to designate members of your team as Reviewers. Reviewers may approve or deny a Label, open an issue on a Label, and make modifications to the Label.
The review queue contains the percentage of submitted or skipped assets configured in the Review step for the project. The review queue abides by the following rules:
Only submitted or skipped assets can be entered into the review queue.
With additional configuration, an asset in the review queue may be reviewed by more than one user, but never twice by the same user.
Members with the Reviewer role will see these assets in a special review interface. Reviewers are able to modify the annotations and submit their reviews by approving or rejecting the labeled assets.
Enable the Review step by doing the following:
Select a project.
Go to the Settings tab.
Toggle on the Review step.
Set the Coverage and click Confirm changes.
Go to the Labels tab.
Click Review labels to enter review mode.
The Reviews section in the Project overview tab contains a simple metric for understanding the general trends in user reviews.
Labels that have received reviews and have an equal count of upvotes and downvotes are currently not filterable.
No reviews at all
Labels where the majority upvoted
Labels where the majority downvoted
Number of issues in the project (see Issues & comments )
Updated 3 months ago