Create customizable, multi-step review and rework pipelines using the node-based editor
Default workflow in the editor
Status | Definition |
---|---|
To label | Data rows that have less than the number of required labels associated with them. In other words, these are data rows that have no labels (if they are non-consensus or non-benchmark data rows). For consensus or benchmark data rows, these would be data rows with less the number of required labels, for example, two labels created when the data row needs three labels for completion. |
In review | Data rows that are in one of the review tasks within the . |
In rework | Data rows that are in the rework task within the workflow. |
Done | Data rows that have all required labels completed and have passed through all review steps within the workflow. |
Filter | Description |
---|---|
Labeled by | The user who labeled the data row |
Annotation | The label added to the data row |
Labeled at | The date range for when the label is added |
Consensus average | A range of average label-level consensus scores |
Feature consensus | A range of average feature-level consensus scores. Can select more than one feature schemas in the ontology. |
Dataset | The dataset where the data row comes from |
Issue category | The issue category of issues on the data row |
Batch | The batch where the data row is sent |
Metadata | The non-annotation metadata information on the data row |
Model prediction | The Foundry model predicted label of the data row |
Labeling time | The labeling time spent on the data row |
Review time | The review time spent on the data row |
Natural language | A natural language expression and confidence score range matching data rows with similar vector embeddings. |
Label feedback | The label feedback score range |
Sample probability | The likelihood of a data row being included in the task. For example, a sample probability of 40% means each data row that meets the other filters has a 40% chance of being included in the task. |