Labeling data is an inherently collaborative process that requires continuous feedback between labelers and reviewers to ensure high-quality outcomes. In the Labelbox Editor, you can facilitate this collaboration throughout the labeling and reviewing process by creating an issue on the asset and opening it up to discussion in the comments section.

How it works

Once a Label is submitted or skipped, the issues on that labeled asset will become visible to reviewers on that project. Team members can then comment on those issues or create new issues. Once an issue has been fully addressed, you can change the status to resolved, signaling to other users that the issue has been fixed or the question has been answered.

📘

Note

Issues on labeled assets that have not been submitted nor skipped will not be visible to other team members, nor will they appear in the Issues tab. Make sure to click Submit or Skip in the Editor for issues to be visible.

Resolved issues are hidden by default.

Issues and comments operate at the project level, not at the organization level. Permissions for creating and modifying issues vary depending on the user's role. These same permissions apply to Workforce user roles but only for labeled assets created by users in that workforce organization.

Create an issue

1. In the Editor, click on the issues icon in the top left corner to activate the tool.

2. Click on the image where you would like to apply the Issue.

3. Enter the content for the issue (e.g., a description of a problem, a question about an annotation, etc.) in the text box.

4. Hit the Enter key to create the issue.

View all issues for a project

1. Select a project and go to the Issues tab.

2. Filter the issues by state by selecting All, Open, or Resolved.

Create a comment on an issue

1. Go to the Issues tab and select an Issue OR click on an issue in the Editor.

2. Enter your response to the Issue in the Reply text box.

3. Hit the Enter key to create the comment.

Edit, resolve, or delete an issue

1. On the Issue, click on the more options menu.

2. Select Edit to change the content of the issue/comment, Resolve to close the issue, or Delete to remove it entirely. Access to these actions will vary based on permissions.

3. If you are the author of an Issue, you can drag and drop it to move its location on the image.