Video editor
When you attach a video to a project, the Labelbox Editor will automatically adjust the Editor interface for video labeling.
Import video data
This is the import format for video data. For more information on importing videos to Labelbox, see our docs on Video import format.
Make sure your video files meet the following specifications:
- MP4 format
- Encoded with H.264
[
{
"externalId": "google-cast.mp4",
"videoUrl": "https://commondatastorage.googleapis.com/gtv-videos-bucket/CastVideos/dash/DesigningForGoogleCastVideo.mp4"
},
{
"externalId": "bigger-blazes-video.mp4",
"videoUrl": "https://commondatastorage.googleapis.com/gtv-videos-bucket/CastVideos/dash/ForBiggerBlazesVideo.mp4"
}
]
[
{
"externalId": "case_video_000_001_12630-14430.mp4",
"videoUrl": "https://lb-test-videos.s3.us-west-1.amazonaws.com/case_video_000_001_12630-14430.mp4"
},
{
"externalId": "case_video_000_001_12630-14431.mp4",
"videoUrl": "https://lb-test-videos.s3.us-west-1.amazonaws.com/case_video_000_001_12630-14431.mp4"
}
]
Supported annotation types for video
Below are the annotation types you may include in your ontology when you are labeling video data.
Scope of classifications
Classifications in the video editor can only be applied at the frame level (asset level and nesting not yet supported).
Annotation type | Import | Export |
|---|---|---|
Segmentation mask (beta) | ||
Bounding box | ||
Point | ||
Polyline | ||
Radio classification (global only) | ||
Checklist classification (global only) |
Video editor components
This is what the Editor will look like when you are labeling video data.
When a video has audio, you'll be able to play the sound back in the Editor.
Editor component | Description |
|---|---|
Tools menu | Contains the list of annotation classes (AKA ontology) for your project. |
Annotations menu | Lists all of the annotations that have been created so far. |
Progress bar | A visual indicator of the temporal progression of the frame sequence. You can hover over the progress bar to quickly preview any frame in the video. |
Classification panel | Appears only for classification-type annotations (e.g., Radio). Here you can apply select answer(s) on a classification question and toggle the classification on/off. |
Timeline | Displays a temporal visualization of all created annotations on the video clip. Indicates the frames on which the annotation was created. You can hover over the timeline to preview any frame in the video. |
Keyframe | A keyframe is a frame in the sequence where an annotation starts, ends, or is modified in some way. A keyframe is indicated on an annotation track as a small circle. The frames between two keyframes are called interpolated (tweened) frames. This is because Labelbox uses interpolation to incrementally adjust the size and position of an annotation on frames in between keyframes. Note: interpolation is not applied to classifications. |
Volume | Sometimes, to make a certain classification in a video, you need to be able to hear and see the content in the frame sequence. When a video has audio, your labeling team will be able to hear the audio during video playback (but not when hovering or stepping through with arrow keys). Labelers can adjust the volume level and click the volume button to mute/unmute audio playback. You can use the Video editor to classify videos with both audio and visual content or audio content alone. To use the Video editor to label audio only, please reach out to Support for details. |
Interpolation
When you are labeling videos in the Editor, you can customize the following for each annotation:
-
The selected frames to persist the annotation
-
The size of the annotation (only applies to bounding box)
-
The position of the annotation on the frames (does not apply to classifications)
By default, when you apply an annotation to a single frame, the annotation will persist until the last frame of the video.
If you would rather limit an annotation to a set of frames, you must select the set of frames before applying an annotation to the frame selection.
When you insert a new keyframe (i.e., change the position or size of an annotation) between two existing keyframes, Labelbox will re-interpolate the frames between the affected keyframes.
When an object of interest exits the frame, then reappears 1 or more frames later, use the toggle icon to turn on/off the annotation. Toggle on/off annotations on multiple frames at a time is not supported. Note: Toggle on/off does not apply to classifications.
Updated about 13 hours ago