Image and Video Labeling

Interactive image and video labeling for object detection, semantic segmentation, and image classification

Use the Image Labeler and the Video Labeler app to interactively label ground truth data in a collection of images, video, or sequence of images. You can label rectangular regions of interest (ROIs) for object detection, pixels for semantic segmentation, and scenes for image classification. The app also includes computer vision algorithms to automate the labeling of ground truth data for use with detection and tracking algorithms. It also provides an API and workflow that enables you to import your own algorithms to automate the labeling of ground truth data.

To get started labeling a collection of images, see Get Started with the Image Labeler. To get started labeling a video, see Get Started with the Video Labeler.

Apps

Image LabelerLabel images for computer vision applications
Video LabelerLabel video for computer vision applications

Functions

expand all

attributeTypeAttribute type enumerations for labeling
changeFilePathsChange file paths in ground truth data
labelTypeLabel type enumerations for labeling
selectLabelsByGroupSelect ground truth labels by label group
selectLabelsByTypeSelect ground truth labels by label type
selectLabelsByNameSelect ground truth labels by label name
objectDetectorTrainingDataCreate training data for an object detector
pixelLabelDatastoreDatastore for pixel label data
pixelLabelTrainingDataCreate training data for semantic segmentation from ground truth
groundTruthGround truth label data
groundTruthDataSourceObject for storing ground truth data sources
labelDefinitionCreatorObject for storing, modifying and creating label definitions table
create Create label definitions table from the label definition creator object
infoDisplay information about a label, sublabel, or attribute stored in label definition creator object
addLabelAdd label to label definition creator object
addSublabelAdd sublabel to label in label definition creator object
addAttributeAdd attributes to label or sublabel in label definition creator object
editLabelGroupModify a label group name
editGroupNameChange group name
editLabelDescriptionModify description of label or sublabel in label definition creator object
editAttributeDescriptionModify description of attribute in label definition creator object
removeLabelRemove label from label definition creator object
removeSublabelRemove sublabel from label in label definition creator object
removeAttributeRemove attribute from label or sublabel in label definition creator object
groundTruthGround truth label data
vision.labeler.AutomationAlgorithmInterface for algorithm automation in ground truth labeling
initializeInitialize state for algorithm execution (optional)
runRun label automation on every frame in interval
terminateTerminate automated algorithm (optional)
checkSetupSet up validation (optional)
checkSignalTypeValidate signal type
checkLabelDefinitionValidate label definition
settingsDialogDisplay algorithm settings (optional)
vision.labeler.mixin.TemporalMixin interface for adding temporal context to automation algorithms
supportsReverseAutomationSet reverse algorithm automation flag

Topics

Get Started

Choose an App to Label Ground Truth Data

Decide which app to use to label ground truth data: Image Labeler, Video Labeler, Ground Truth Labeler, Lidar Labeler, Signal Labeler, or Audio Labeler.

Get Started with the Image Labeler

Interactively label rectangular ROIs for object detection, pixels for semantic segmentation, and scenes for image classification.

Get Started with the Video Labeler

Interactively label rectangular ROIs, polylines, or pixels in a video or image sequence.

Keyboard Shortcuts and Mouse Actions for Image Labeler

Use keyboard shortcuts and mouse actions to increase productivity while using the Image Labeler app.

Keyboard Shortcuts and Mouse Actions for Video Labeler

Use keyboard shortcuts and mouse actions to increase productivity while using the Video Labeler app.

Load Ground Truth Data Sources

Use Custom Image Source Reader for Labeling

Create a reader function to load a custom image data source into the Ground Truth Labeler or Video Labeler.

Label Ground Truth

Label Pixels for Semantic Segmentation

Label pixels for training a semantic segmentation network by using a labeling app.

Use Sublabels and Attributes to Label Ground Truth Data

Learn how ROI sublabels and attributes work in labeling apps.

View Summary of Ground Truth Labels

View a summary of ROI and scene labels in a labeling app session.

Automate Labeling

Create Automation Algorithm for Labeling

Create a custom automation algorithm to use in a labeling app.

Temporal Automation Algorithms

Create a time-based custom tracking algorithm to import into a labeling app.

Use Ground Truth Labels

Share and Store Labeled Ground Truth Data

Share and store labeled ground truth data exported from labeling apps.

How Labeler Apps Store Exported Pixel Labels

Learn how the labeling apps store pixel label data.

Training Data for Object Detection and Semantic Segmentation

Create training data for object detection or semantic segmentation using the Image Labeler or Video Labeler.

Computer Vision Toolbox Documentation

Support