Catalog search and view compatibility

A summary view of search capabilities by data type

While the filters noted below are supported out of the box, Labelbox supports multiple strategies to extend the core offerings. You can bring your own custom metadata and enhance similarity search capabilities using custom embeddings.

Then, combine any supported filters with your enriched metadata and embeddings to accomplish any of your search and curation objectives. For more information on combined searches, check out the page here.

Supported search filters (basic)

Asset typeAnnotationDatasetMetadataProjectMedia attributeBatchData row
Image
Video
TextOnly mime type
HTMLOnly mime type
DocumentOnly mime type
Tiled imageryOnly mime type
DICOMOnly mime type
Audio
ConversationalOnly mime type

Make any data type queryable with custom metadata

As noted above, Labelbox supports metadata on any data type. Consider the abundance of ways in which you can extend our core filters with custom metadata and the various sources you can utilize to create this information.

For an example of how to get started, check out this blog post on how to make your data queryable using foundation models.

Supported search filters (advanced)

Asset typeFind textNatural language
Image-✔*
Video--
Text-
HTML-
Document-
Tiled imagery-✔*
DICOM--
Audio--
Conversational-

* Natural language search uses the off-the-shelf CLIP-ViT-B-32 model (512 dimensions).

Similarity (embeddings)

Asset typeOff-the-shelfCustom
ImageCLIP-ViT-B-32 (512 dimensions)Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
Video-Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
Textall-mpnet-base-v2 (768 dimensions)Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
HTMLall-mpnet-base-v2 (768 dimensions)Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
DocumentCLIP-ViT-B-32 (512 dimensions)Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
Tiled imageryCLIP-ViT-B-32 (512 dimensions)Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
DICOM-Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
Audio-Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.
Conversational-Up to 2048 dimensions per embedding; up to 100 custom embeddings per workspace.

Search for similarity on any data type with custom embeddings

As noted above, Labelbox supports custom embeddings on any data type. Powerful embeddings can be generated using foundational models and easily uploaded to Labelbox. You can then use these embeddings in combination with any of the above filters to accomplish virtually any data search goal.

For an example of how to get started, check out this guide on how to generate custom embeddings using foundational models and upload them to Labelbox.

Data viewing

Asset typeThumbnail viewDetail viewAnnotations overlay (thumbnail)Annotations overlay (detail)
Image
Video-Classifications only
Text
HTML-
DocumentClassifications onlyClassifications only
Tiled imagery
DICOM-
Audio--
Conversational---Classifications only