Catalog search and view compatibility
A summary view of search capabilities by data type
While the filters noted below are supported out of the box, Labelbox supports multiple strategies to extend the core offerings. You can bring your own custom metadata and enhance similarity search capabilities using custom embeddings.
Then, combine any supported filters with your enriched metadata and embeddings to accomplish any of your search and curation objectives. For more information on combined searches, check out the page here.
Supported search filters (basic)
Asset type | Annotation | Dataset | Metadata | Project | Media attribute | Batch | Data row |
---|---|---|---|---|---|---|---|
Image | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ |
Video | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ |
Text | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
HTML | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
Document | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
Tiled imagery | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
DICOM | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
Audio | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ | ✔ |
Conversational | ✔ | ✔ | ✔ | ✔ | Only mime type | ✔ | ✔ |
Make any data type queryable with custom metadata
As noted above, Labelbox supports metadata on any data type. Consider the abundance of ways in which you can extend our core filters with custom metadata and the various sources you can utilize to create this information.
For an example of how to get started, check out this blog post on how to make your data queryable using foundation models.
Supported search filters (advanced)
Asset type | Find text | Natural language |
---|---|---|
Image | - | ✔* |
Video | - | - |
Text | ✔ | - |
HTML | ✔ | - |
Document | ✔ | - |
Tiled imagery | - | ✔* |
DICOM | - | - |
Audio | - | - |
Conversational | ✔ | - |
* Natural language search uses the off-the-shelf CLIP-ViT-B-32 model (512 dimensions).
Similarity (embeddings)
Asset type | Off-the-shelf | Custom |
---|---|---|
Image | CLIP-ViT-B-32 (512 dimensions) | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Video | - | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Text | all-mpnet-base-v2 (768 dimensions) | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
HTML | all-mpnet-base-v2 (768 dimensions) | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Document | CLIP-ViT-B-32 (512 dimensions) | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Tiled imagery | CLIP-ViT-B-32 (512 dimensions) | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
DICOM | - | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Audio | - | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Conversational | - | Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace. |
Search for similarity on any data type with custom embeddings
As noted above, Labelbox supports custom embeddings on any data type. Powerful embeddings can be generated using foundational models and easily uploaded to Labelbox. You can then use these embeddings in combination with any of the above filters to accomplish virtually any data search goal.
For an example of how to get started, check out this guide on how to generate custom embeddings using foundational models and upload them to Labelbox.
Data viewing
Asset type | Thumbnail view | Detail view | Annotations overlay (thumbnail) | Annotations overlay (detail) |
---|---|---|---|---|
Image | ✔ | ✔ | ✔ | ✔ |
Video | ✔ | ✔ | - | Classifications only |
Text | ✔ | ✔ | ✔ | ✔ |
HTML | ✔ | ✔ | - | ✔ |
Document | ✔ | ✔ | Classifications only | Classifications only |
Tiled imagery | ✔ | ✔ | ✔ | ✔ |
DICOM | - | ✔ | ✔ | |
Audio | - | ✔ | - | ✔ |
Conversational | - | - | - | Classifications only |
Updated 4 days ago