March 5, 2024
7 months ago
Release notes
App
Added
- Smart select (beta) in Catalog offers three different ways to curate your data within a dataset: random, ordered, and cluster-based. To access this feature, go to Catalog, select a dataset that is larger than 100 data rows, and select "Smart select".
- Cluster view (beta) in Catalog is a new interface that helps you discover and find similar data rows as well as labeling or model mistakes. See Cluster view for more details.
- Natural language search and similarity search in Catalog now support video and audio assets.
- You can now 1) import custom metrics per prediction and 2) filter/sort by prediction-level custom metrics. These added functionalities make it easier to use our model error analysis tools in the Model product. To learn more about prediction-level metrics on model runs, see Filters.
- You can now invoke Foundry models from within a project to generate pre-labels. In the project overview, you'll see "suggested models" to help you select the best model for generating predictions. This feature is in beta.
- The new Audit trail feature provides a way for you to view all operations (create, update, and delete) on an annotation. This feature makes monitoring changes to annotations over time easier for auditing purposes.
- The new enhanced video player (beta) in Catalog offers new capabilities to help you curate, evaluate, and visualize video data. These new capabilities include basic play/pause controls, support for predictions, pre-labels, ground truth (bounding boxes, polylines, and points), and support for comparing model runs.
- If you export from an image or video labeling project that contains data rows labeled with segmentation masks, you will see a new property in the export file called composite_mask. Composite masks are a grouping of all segmentation masks on a label. To learn more, see Export image annotations.
- If you export from a model run that contains segmentation mask predictions, you will see a new property in the export file called composite_mask. To learn more, see Export image annotations.
- You can now have a workflow filter based on consensus average. For example, you can use this filter to send data rows with a consensus score over 80% straight to "Done". To do this, create a new workflow step and select consensus average from the workflow filters.
- Boost express makes it easier for you to request help labeling data. Once you've set up a project, you can request up to fifteen labelers to work on your data. See our docs on Boost express to learn more.
- The billing tab in your Workspace settings now has a button that enables you to easily unsubscribe from Foundry.
Changed
- When you select a project in Annotate, you will see a new project overview UI that makes navigating your project easier.
- We have disabled the ability to download videos from the preview mode for all users.
- When you are in a project, you will now see a "Start" button with a dropdown menu containing options for labeling, reviewing, and any other tasks you have configured for your project.
Fixed
- Google SSO users that have a profile picture on their account can now log in as expected.
- The issue causing large numbers of data rows to be stuck in the “To Label” task has been fixed.
- The Enterprise dashboard now displays the correct information for your organization.
- In the Data row details panel, the row data can no longer be displayed with the security token.
Future
- Starting in mid-April, we will sunset export v1 on a rolling basis. To view the sunset date for your tier, see the Export v1 to v2 migration guide.
Python SDK
The latest version of our Python SDK is v3.65.0. See our full changelog in Github for more details on what was added recently.
Version 3.65.0 (2024-03-05)
Notes
- Rerelease of 3.64.0
Version 3.64.0 (2024-02-29)
Added
Client.get_catalog
Add catalog schema class. Catalog exports can now be made without creating a slice firstlast_activity_at
filter added to export_v2, allowing users to specify a datetime window without a slice
Removed
- Review related WebhookDataSource topics
Notebooks
- Added get_catalog notebook
- Update custom metrics notebook
- Update notebooks for video and image annotation import
Version 3.63.0 (2024-02-19)
Added
- Ability for users to install and use sdk with pydantic v.2. while still maintaining support for pydantic v1.
ModelRun
export()
andexport_v2()
add model_run_details to support splits
Notebooks
- Add composite mask notebook
Version 3.62.0 (2024-02-12)
Added
- Support custom metrics for predictions (all applicable annotation classes)
FoundryClient.run_app
Add data_row identifier validation for running foundry appClient.get_error_status_code
Default to 500 error if a server error is unparseable instead of throwing an exception
Updated
DataRowMetadata, DataRowMetadataBatchResponse, _UpsertBatchDataRowMetadata
Make data_row_id and global_key optional in all schema types
Fixed
ExportTask.__str__
Fix returned type in ExportTask instance representation
Removed
Project.upsert_review_queue
Notebooks
- Update notebooks to new export methods
- Add model slice notebook
- Added support for annotation import with img bytes
- Update user prompts for huggingface colab