Visualize model predictions
Once predictions have been uploaded to a Model Run, you can use Models to visually compare model predictions against ground truth labels. This qualitative inspection should help you better understand the model's behavior.
Here are the steps to easily visualize predictions in a Model Run:
-
Go to the Models tab.
-
Select the Model want to visualize.
-
Select the Model Run you want to visualize.


- By default, you will see the model predictions for each Data Row in the Gallery view. You can come back to this view, by clicking on this icon in the top right, above the thumbnails.


Click on the Model Run name, to see all Model Runs available inside this Model. This way, you can easily switch from one Model Run to another.
Gallery view
In the gallery view, annotations are green with solid lines and predictions are red with dashed lines.


Filter data rows
Instead of viewing all of the predictions at once, it can be helpful to visually inspect the predictions on a subset of the Model Run data.
For example, you might want to gain an understanding of your model's behavior on a particular data split. You can do so by clicking on Train, Validate, or Test. The gallery view will only show the Data Rows in the train, validation, and test splits of the Model Run. Clicking on All shows the entire data of the Model Run.


You can visualize the data rows from the test split, by clicking on "Test"
You may also want to inspect your model's behavior on a specific label class. You can do so by adding a filter. If you add the filter "Label contains = airplane”, the gallery view will show all of the Data Rows that contain an “airplane” ground truth annotation.
Labelbox supports the following filters in Models: Label contains, Label ID, Datarow ID, Datasets, Project, Metrics. You can combine these filters using And and Or conditions.


The training data of the Model Run is filtered, to keep only data rows containing an "airplane" annotation
Slices: save a set of filters
You can save any set of filters, by turning the filtered Data Rows into a Slice. To do so, once are happy with your current set of filters, click on the "Save slice" button.


Saving a slice with 3 filters: data rows are selected based on label class, project and metrics
You can then easily access these Data Rows by clicking on "Select slice" and by selecting any previously created Slice.


Sort data rows in the grid view
If you have uploaded metrics to the Model Run, you can sort data rows in the grid view based on these metrics. To do so:
- Click on "Sort"
- Select a metric to sort by
- Select an ordering: ascending or descending
All metrics in the Model Run are available for sorting:
- scalar metrics or confusion matrix metrics
- confusion matrix metrics are available as global metrics (value is averaged across classes) or as class-level metrics


Sorting data rows in the grid view, by IoU (scalar metric), in descending order
Combining sorting and filtering
You can combine filtering and sorting, in the grid view, to unlock powerful workflows. Learn more about the following workflows, to improve model performance, increase labeling quality and efficiency, and reduce labeling budget.
- Finding and fixing model errors.
- Finding and fixing labeling mistakes.
- Identifying high value data to label in priority (active learning).


Sorting and filtering can be combined
Detailed view
You can access the detailed view, by clicking on any thumbnail. The detailed view is designed to inspect in details a particular data row.
In the detailed view, labels are green with solid lines and predictions are red with dashed lines. You can zoom in on the data with the mouse wheel.


Toggle annotation color
Hotkey: Shift + c
By pressing Shift+c
, you can view annotations by their ontology or source (Model or Label)


Toggle individual annotations
Using the right nav you can toggle on/off predictions/annotations. Entire features can be toggled in addition to all annotations on the data row.


Toggle all annotations
Hotkey: Shift + s
By pressing Shift+s
, you can toggle all annotations on/off. You can use this to better inspect the underlying data.
Updated 21 days ago