What's new

​

Updated

• DataRowMetadata: Remove enforcement of character limit

​

Fixed

• Project Setup: Remove project setup complete restriction
• API key creation: fix support of role with a space in the name
• Workflow cloning: Fix validation for some nodes

​

Fixed

• reset_to_initial_nodes() and clone_workflow_from() will not update initial node IDs anymore

​

Added

• Add the ability to specify relationship constraints

​

Fixed

• Minor fixes to CRUD operations when specifying user groups

​

Added

• Add support for Likert scale
• Add creation of IAM integrations
• Add workflow management
• Add model app ID to model run creation and return it
• Add support for project ontology change
• Remove mypy from dependencies

​

Updated

• BREAKING CHANGE UserGroup no longer supports the users field - it’s been replaced by the members field.
• Update UserGroup to fix project membership

​

Fixed

• ApiKey.created_by now correctly displays the user for old API keys

​

Added

• API key management using the SDK
• Methods for getting and canceling invitations to workspaces or projects
• The organization.tasks() method for getting organization tasks and the TaskStatus enum for filtering both organization and user tasks

​

Added

• Task cancellation for supported task types
• AUDIO as a supported attachment type

​

Added

• An optional source_ontology_name field to Relationship class. You can now specify relationships using source_ontology_name instead of a concrete source annotation. This approach is especially useful for PDF document annotations because it allows you to reference ontology classes directly when you create relationships.
• Validation ensures that either source or source_ontology_name is provided, but not both
• Support for searching by name for get_catalog_slice
• get_catalog_slices to get all slices

​

Added

• (Beta) MAL support for PDF relationships
• (Beta) readonly setting for relationships

​

Added

• Support for python 3.13
  • Note: minimum numpy version that supports python 3.13 is 2.1
• Include predictions in slice export

​

Fixed

• GraphQL upload SSL configuration

​

Added

• Support including predictions in catalog exports

• Add feature schema attributes to support the auto OCR tool in ontologies
• task_queue_id is now optional and defaults to None for better type support when moving data rows to a workflow task

​

Added

• Group member upload
• Group member export

​

Added

• Multimodal chat evaluation ontology support for two new tools:
  • Prompt rating: Example export payload
  • Fact-checking: Example export payload
• Added the following new import methods that replace the deprecated BulkImportRequest class:
  • project.get_mal_prediction_imports() to retrieve the list of MAL import jobs.
  • project.get_label_imports() to to retrieve the list of ground-truth import jobs.
  • MALPredictionImport.delete() to delete a MAL import.
• Deprecation warning to wait_until_done methods
• Deprecation warning to get_data_row_ids

​

Fixed

• Fixed relationship label bug
• Fixed the Import lb-client exceptions for labelbox
• Fixed get_roles return type to Dict[str, Role] (instead of List[Role])
• Adjusted deprecation message to a new standard
• Improved support for Client.enable_experimental

​

Added

• Added the step reasoning ontology tool .

​

Fixed

• Use valid lbox.exception in client IAMIntegration validation
• Improve SDK method name detection for Datadog dashboard
• Limit labeling front-end visibility and mentions of a custom editor
• Remove all unused python imports
• Remove bulk import requests

​

Fixed

• Updated labelbox.exceptions to lbox.exceptions for IAM Integration check

​

Added

• Added deprecation messages to all export_v2 methods
• Added logic to extract SDK methods to pass to Datadog dashboard
• Added the lbox.request_client Graphql client as a separate component

​

Updated

• Updated the minimum requirement of numpy version from 1.24 to 1.25 and cleaned up _TypedArray validations
• Refactored client create_project inputs to be named parameters instead of **kwargs
• Updated pydantic v2 deprecation warnings
• Removed experimental from UserGroup
• Improved labeling service error reporting
• Switched to ruff linter

​

Fixed

• Labeling dashboard serialization
• Handling of global key in ModelEvaluationTemplate

​

Removed

• Discontinued the support for Python 3.8
• Removed various deprecated classes, methods and attributes, including:
  • QueueMode for project
  • LabelGenerator assign_feature_schema_ids
  • Label assign_feature_schema_ids
  • AttachmentType attachment_type.TEXT
  • DataRowMetadata bulk_delete deletes parameter - support for string for data row ids or global keys, use UniqueId or GlobalKey class instead
  • Dataset create_data_rows_sync. Use create_data_rows instead
  • Slice get_data_row_ids. Use get_data_row_identifiers instead
  • LabelingParameterOverrideInput remove instance of DataRow as a type of input
  • Project _update_queue_mode and get_queue_mode
  • Project.setup and Project.setup_editor. Use project.connect_ontology instead
• Removed deprecated get stream - related classes from ExportTask
  • JsonConverter, JsonConverterOutput, FileConverter, FileConverterOutput
• Removed label Data classes as Label data attribute. Use GenericDataRowData instead
  MaskData is NOT removed
• Removed NDJsonConverter deserialize
• Removed the COCO package and BulkImportRequest package, including:
  • BulkImportRequest
  • BulkImportRequestState
  • project.upload_annotations
  • project.bulk_import_requests

​

Fixed

• Exporter encoding

​

Added

• Support data row / batch for live mmc projects(#1856)

​

Added

• Support self-signed SSL certs(#1811)
• Rectangle units now correctly support percent inputs(#1848)

​

Updated

• Set tasks_remaining_countattribute of labeling service dashboard to None if labeling has not started.
• Improve error messaging when creating LLM project with invalid dataset id parameter.

​

Removed

• BREAKING CHANGE: Export v1 SDK methods are all removed. Use the latest export methods instead.
• BREAKING CHANGE: Unused labelbox_v1 serialization package is removed.

​

Fixed

• Fixed CUID dependencies that cause a crash if numpy is not installed.

​

Added

• BREAKING CHANGE for Pydantic v1 users: Labelbox Python SDK now uses Pydantic v2.
• Added automation test support for multiple SDK versions.

​

Fixed

• Fixed flaky tests.

​

Fixed

• Fixed labeling dashboard query for tags.

​

Added

• Added project.get_labeling_service_dashboard() and client.get_labeling_service_dashboards(), which can retrieve information of projects with labeling service requested. See Get labeling service details.
• Added client.get_task_by_id(), which fetches tasks by their IDs. See Get tasks .
• Added support for importing multimodal chat annotations .

​

Fixed

• Restored client.headers.

​

Added

• Added labeling_service.request(), which validates all project requirements and requests a labeling service. See Labeling Workforce.
• Added the is_benchmark_reference flag that supports importing ground truth labels as benchmarks. See import annotations guides for example payloads.

​

Updated

• get_labeling_service() now automatically requests labeling service if none has been used on a project. See Labeling Workforce.

​

Removed

• BREAKING CHANGE: Removed Project.labeling_frontend.disconnect(). Now you can only have one default labeling front end per project and can’t disconnect it.
• BREAKING CHANGE: Removed the experimental method project.request_labeling_service(). See Labeling Workforce for the latest approach.

​

Added

• Added experimental methods Project.get_labeling_service(), request_labeling_service() and get_labeling_service_status() that support requesting and checking the status of labeling service. See Labeling Workforce.
• Added Client.create_prompt_response_generation_project() and create_response_creation_project() methods that support project and ontology creation for prompt response projects. See Import prompt and response annotations and Prompt and response projects to learn how to use these methods to set up prompt and response projects.
• Added is_benchmark_enabled and is_consensus_enabled flags that specify whether a project supports benchmarks and consensus .

​

Updated

• Made Project quality modes a list to allow combining more than 1 quality mode per project.

​

Notebooks

• Added back the python notebook on migrating from Export V1 to the latest export().
• Added correct data param to the video notebooks.

​

Other

• Use connection pool for all http and graphql requests

​

Removed

• Project media_type no longer supports JSON

​

Added

• Added project.set_project_model_setup_complete() method
• Added user group management methods.
• Refactored dataset.create_data_rows_sync to upsert
• Added upload_type to Project
• Added prompt classification for python object
• Alias wait_xxx functions

​

Fixed

• Predictions missing during Catalog slice Export
• Prevented adding batches to live chat evaluation projects
• Added missing media types
• Deprecate project.setup_editor in favor of project.connect_ontology
• Bumped dateutil max version
• Bumped version rye
• Updated create ontology for project setup

​

Added

• Include predictions in export
• Adds upsert label feedback method client upsert_label_feedback()

​

Removed

• Removed deprecated class LabelList

​

Added

• Conversational data row checks
• UI ontology mode support
• Empty data row validation

​

Fixed

• Numpy semver locked to < 2.0.0

​

Added

• SLSA provenance generation

​

Fixed

• Fix client.get_project() for LLM projects
• Throw user-friendly errors when creating a custom embedding

​

Added

• Update Dataset create_data_rows to allow upload of unlimited number of data rows
• New Dataset methods for iam_integraton: add_iam_integration, remove_iam_integration

​

Notebooks

• Added model evaluation SDK method notebook
• Added quick start notebook geared towards new users

​

Added

• project.get_overview() to be able to retrieve project details
• project.clone() to be able to clone projects
• Support for Rye 0.34
• Requirements.lock, Requirements-dev.lock to latest depdenencies
• ExportTask.get_buffered_stream to replace ExportTask.get_stream

​

Fixed

• ExportTask.result / ExportTask.errors parsing content incorrectly
• Lack of exceptions related to updating model config

​

Added

• Added chat model evaluation support:
  • client.create_model_config()
  • project.project_model_configs()
  • project.add_model_config()
  • project.delete_project_model_config()
  • ProjectModelConfig.delete()
  • client.create_model_evaluation_project()
• Update existing methods to support chat model evaluation project
  • client.create_ontology()
  • client.create_ontology_from_feature_schemas()
• Coco deprecation message

​

Fixed

• Fixed error reporting for client.create_project()
• Do not retry http 422 errors

​

Notebooks

• Send_to_annotate_from_catalog functionalities outside Foundry

​

Fixed in Notebooks

• Fixed meta notebook
• Modified queue_management.ipynb to remove some parameters
• Update_huggingface.ipynb
• Corrected_HF.ipynb