Learn how to set up consensus scoring to analyze the quality of your labels.
Asset type | Bounding box | Polygon | Polyline | Point | Segmentation mask | Entity | Relationship | Radio | Checklist | Free-form text |
---|---|---|---|---|---|---|---|---|---|---|
Image | N/A | N/A | - | |||||||
Video | - | - | N/A | N/A | - | |||||
Text | N/A | N/A | N/A | N/A | N/A | - | - | |||
Chat | N/A | N/A | N/A | N/A | N/A | - | - | |||
Audio | N/A | N/A | N/A | N/A | N/A | N/A | N/A | - | ||
Geospatial | N/A | N/A | - | |||||||
Documents | N/A | N/A | N/A | N/A | N/A | |||||
HTML | N/A | N/A | N/A | N/A | N/A | N/A | N/A | |||
Human-generated responses | N/A | N/A | N/A | N/A | N/A | N/A | N/A |
Consensus setting | Description |
---|---|
Data row priority | The position in the labeling queue these data rows will be slotted based on priority. |
% coverage | The percentage of the data rows in the batch that will enter the labeling queue as consensus data rows for multi-labeling. Defaults to 0. |
# labels | The number of labels that each consensus data row will be added. Defaults to 2. Must be less than or equal to the number of labelers on the project. |