Labeling services

Labelbox offers labeling services that connect you with labelers with specialized knowledge, such as medical experts, various languages, and other certified specialties, to annotate and review large amounts of data for you.

• For enterprise plans, labeling services are included in the plan and fully managed without extra charge.
• For all other plans and tiers, labeling services are self-serving and can be requested per project.

Powered by the Alignerr community of highly-educated experts proficient in major languages and advanced subjects, the labeling service can help you on critical post-training and GenAI tasks, such as :

• Reinforcement Learning with Human Feedback (RLHF)
• Supervised fine-tuning (SFT)
• Multimodal LLM evaluation
• Preference ranking
• LLM chat arena
• Red teaming
• Text-to-image, video, and audio tasks
• Coding and AI agent tasks

The service supports a rapidly expanding set of languages:

• Arabic
• English
• French
• German
• Hindi
• Indonesian
• Italian
• Japanese
• Korean
• Portuguese
• Spanish
• Vietnamese

Set up labeling services

To add labeling services to your projects:

1. On the Labelbox app home page, click Request labeling services.
2. Select the project you’d like to request labeling workforce or click + New project with labeling services. If you choose to create a new project, complete the project setup steps.
3. On the selected project page, click Add instructions to add labeling instructions for labelers. You can type directly into the editor or use the Add button to upload a file. Select Save when finished.

If you are on an enterprise plan, you can see a tracker on the project overview page that display the labeling status after saving the labeling instructions,. The initial status stage is Requested. Under this stage, you can edit your labeling instructions by clicking Edit instructions.

If you are on a non-enterprise plan, you need to complete the following payment steps before seeing the labeling status tracker:

1. Back on the project page, click complete payment.
2. On the prompted checkout screen, set Qty to the number of labeler you want to request. The minimum team size is one (1) person for one week (40 hours), and you can select up to 15 team members. If you need a larger team, contact Sales.
3. Complete the payment info and click Pay.

🚧

Renew and refund policy

If you want to request labeling services for ongoing projects, it requires additional payments as each payment is consumed, and you can adjust team size when renewing payments. Unused hours are non-refundable, so we encourage you to add enough data and set an appropriate team size to utilize the labeling time to the fullest extent.

📘

Team size best practices

To determine an appropriate team size, calculate the total number of hours of work required to perform your work and divide that value by 40, rounding up.

Manage labeling workforce

Once you are connected to labelers for working on your projects, you can check their information and manage their access to your project with the following steps:

1. On the project Overview, select Settings.
2. Select Members, then select External workforce.

Security and privacy

Labelbox is committed to ensuring the security and privacy of your data, which involves rigorous security measures and strict privacy protocols to protect sensitive information.

Workforce partner security

Data protection is a top priority for Labelbox. To ensure the most qualified partnerships, our Workforce and Business Process Outsourcing (BPO) vendors undergo a detailed security review regarding the security practices they have implemented. Our partners comply with a wide range of industry compliance standards including ISO 27001, SOC 2, HIPAA, and GDPR.

Notably, all Labelbox workforce partners have thorough role-based access controls (RBAC), ethical business practices policies (including fair wage), and data transfer policies to keep customer data safe and secure. In addition, all partners ensure that their employees strictly follow physical access controls that include, but are not limited to, secure on-premise entry protocols, clean desk protocol, and prohibiting the use of mobile phones in the production environment.

Labelbox does not consider partnerships with companies that do not adhere to the robust security, privacy, and ethical practices of Labelbox.

Data Privacy in Labelbox Workforce Services

In projects utilizing Labelbox workforce services, both BPO service providers and our Workforce members shall not see any personally identifiable information (PII) of customers that can identify an individual or the Organization they are a part of.

• For Labelbox Workforce: They cannot see emails, user names, project names, descriptions, tags, and organization names for the projects they work on.
• For Customers: They cannot see the emails and user names of the BPO members working on their projects.

These privacy settings are automatically applied to all relevant projects to protect sensitive information. For example, on the Performance Dashboard, emails are obfuscated on both sides to prevent Workforce and Customers from identifying each other. For instance, an email like [email protected] would be turned into something like [email protected].