Issues & comments

Labeling data is an inherently collaborative process that requires continuous feedback between labelers and reviewers to ensure high-quality outcomes. In the Labelbox Editor, you can facilitate this collaboration throughout the labeling and reviewing process by creating an issue on the asset and opening it up to discussion in the comments section.

How it works

Once a Label is submitted or skipped, the issues on that asset will become visible to reviewers on that project. Team members can then comment on those issues or create new issues. Once an issue has been fully addressed, users can change the status to resolved, signaling to other users that the issue has been fixed or the question has been answered.

📘

Note

Issues on labeled assets that have not been submitted nor skipped will not be visible to other team members nor will they appear in the Issues tab. Make sure to submit or skip in the Editor for issues to be visible. Also, resolved issues are hidden by default.

Issues and comments operate at the project level, not at the organization level. Permissions for creating and modifying issues vary depending on the user role. These same permissions apply to Workforce user roles but only for labeled assets created by users in that workforce organization.

Role

Permissions

Labeler

  • Can create issues on assets they have labeled in the project.

  • Can update and delete their own issues on assets they have labeled.

  • Can resolve and reopen their own issues.

  • Can create, update, and delete their own comments on assets they have labeled.

Reviewer or Admin

  • Can create issues on any labeled asset.

  • Can delete their own issues on any labeled asset.

  • Can resolve and reopen issues on any labeled asset.

  • Can create, update, and delete comments their own comments on any labeled asset.

How to use Issues & comments

Create an issue

  1. In the Editor, click on the issues icon in the top left corner to activate the tool.

  2. Click on the image where you would like to apply the Issue.

  3. Enter the content for the issue (e.g., a description of a problem, a question about an annotation, etc.) in the text box.

  4. Hit the Enter key to create the issue.

View all issues for a project

  1. Select a project and go to the Issues tab.

  2. Filter the issues by state by selecting All, Open, or Resolved.

Create a comment on an issue

  1. Go to the Issues tab and select an Issue OR click on an issue in the Editor.

  2. Enter your response to the Issue in the Reply text box.

  3. Hit the Enter key to create the comment.

Edit, resolve, or delete an issue

  1. On the Issue, click on the more options menu.

  2. Select Edit to change the content of the issue/comment, Resolve to close the issue, or Delete to remove it entirely. Access to these actions will vary based on permissions.

  3. If you are the author of an Issue, you can drag and drop it to move its location on the image.


Did this page help you?