Every project dashboard contains a Data Rows tab. In the table, you will see all the data rows either labeled or queued in the project listed. Each data row will have some information such as labeling time, review time, dataset, and if there are any open issues.
|Unlabeled||A data row has less than the number of required labels associated with it. In other words, these are data rows that have no labels (for any data rows that require only a single label i.e., any non-consensus or non-benchmark data row).|
For consensus data rows, these would be data rows with less the number of required labels, e.g. 2 labels when the data rows need 3 labels for completion.
|Labeled||Marks data rows that have at least one submitted label associated with it.|
|In review||Marks data rows that are in one of the review tasks within the workflow.|
|In rework||Marks data rows that are in the rework task within the workflow.|
|Done||Marks data rows that have passed through the review process within the workflow.|
Reduced set of statuses
If a project does not have Workflow set up, the only statuses that will show on the data rows tab are:
- Unlabeled when the data row has no labels associated
- Labeled when the data row has at least one label associated
The count of data rows for each given status is visible on the left panel. Clicking on any particular value of status will allow you to look at a filtered view of data rows pertaining to that status.
The Label time for a data row reflects the time spent creating the label on this data row plus any time spent editing the label by the original labeler.
The Review time for a data row reflects the time spent by any other labeler viewing or editing the label made on this data row.
For projects that use consensus, these timing metrics will reflect a sum of the time spent labeling or reviewing on All labels created on the data row.
For projects that are using workflows for review, time spent viewing as well as modifying labels in all review and rework tasks will be added into review time.
If you want to preview the data rows, select the gallery view option in the top right corner of the table. This will take you to a preview mode where we will show a thumbnail of the data row.
For images, Labelbox also will render any bounding box annotations in the preview.
You can filter the list of data rows to the relevant context by applying a filter. To do so, click on the search widget to bring up the different options of attributes that you can filter by.
You can filter your data by the following fields:
- Ground Truth (previously Annotations)
- Media attribute
- Data row (includes subsequent options to filter by Data row ID and External ID
- Label (includes subsequent options to filter by Label ID, Labeled by, Labeled at, Benchmark/Consensus average)
Note that the interface allows you to conduct flexible querying by enabling combinations of AND/OR conditions on attributes (and their values). The example (Wikineural) shows an example where the label/annotation filter uses a combination of OR within a query line as well as an AND across query lines.
As the data rows tab lets you interact with a high number of data rows together, Labelbox enables you to conduct actions in bulk by selecting these data rows together and selecting the desired action.
The following actions are currently enabled for you to perform on a selection of data rows:
Delete and requeue: This allows you to delete a label on a data row that has been labeled and send it back into the labeling queue. Before you confirm, you get the option of preserving the existing label as a template. As a safeguard, bulk delete and requeue actions are presently limited to 100 data rows.
Hide from labelers: This allows you to hide sensitive or inappropriate content from labelers. This will restrict all labelers from being able to view the data row in the editor from that point on. When they try to access the asset, they will instead see a message that states Unauthorized to view this data row.
Updated 16 days ago