Structure From Motion

3-D reconstruction from multiple views

Structure from motion (SfM) is the process of estimating the 3-D structure of a scene from a set of 2-D images.

Apps

Camera CalibratorEstimate geometric parameters of a single camera
Stereo Camera CalibratorEstimate geometric parameters of a stereo camera

Functions

expand all

Store Image and Camera Data

imageviewsetManage data for structure-from-motion, visual odometry, and visual SLAM
worldpointsetManage 3-D to 2-D point correspondences
cameraMatrixCamera projection matrix
cameraIntrinsics Object for storing intrinsic camera parameters
rigid3d3-D rigid geometric transformation

Estimate Camera Poses

estimateEssentialMatrixEstimate essential matrix from corresponding points in a pair of images
estimateFundamentalMatrixEstimate fundamental matrix from corresponding points in stereo images
estimateWorldCameraPoseEstimate camera pose from 3-D to 2-D point correspondences
relativeCameraPoseCompute relative rotation and translation between camera poses

Triangulate Image Points

pointTrackObject for storing matching points from multiple views
findTracksFind matched points across multiple views
triangulate3-D locations of undistorted matching points in stereo images
triangulateMultiview3-D locations of world points matched across multiple images

Optimize Camera Poses and 3-D Points

bundleAdjustmentRefine camera poses and 3-D points
bundleAdjustmentMotionRefine camera pose using motion-only bundle adjustment
bundleAdjustmentStructureRefine 3-D points using structure-only bundle adjustment
createPoseGraphCreate pose graph
detectBRISKFeaturesDetect BRISK features and return BRISKPoints object
detectFASTFeaturesDetect corners using FAST algorithm and return cornerPoints object
detectHarrisFeaturesDetect corners using Harris–Stephens algorithm and return cornerPoints object
detectMinEigenFeaturesDetect corners using minimum eigenvalue algorithm and return cornerPoints object
detectMSERFeaturesDetect MSER features and return MSERRegions object
detectSURFFeaturesDetect SURF features and return SURFPoints object
extractFeaturesExtract interest point descriptors
extractHOGFeaturesExtract histogram of oriented gradients (HOG) features
matchFeaturesFind matching features
vision.PointTrackerTrack points in video using Kanade-Lucas-Tomasi (KLT) algorithm
stereoAnaglyphCreate red-cyan anaglyph from stereo pair of images
pcshowPlot 3-D point cloud
plotCameraPlot a camera in 3-D coordinates
showMatchedFeaturesDisplay corresponding feature points
showReprojectionErrorsVisualize calibration errors
rotationMatrixToVectorConvert 3-D rotation matrix to rotation vector
rotationVectorToMatrixConvert 3-D rotation vector to rotation matrix

Topics

Apps for Camera Calibration

Single Camera Calibrator App

Estimate camera intrinsics, extrinsics, and lens distortion parameters.

Stereo Camera Calibrator App

Calibrate a stereo camera, which you can then use to recover depth from images.

Visual Odometry

Monocular Visual Odometry

Determine location and orientation of a camera by analyzing a sequence of images.

Monocular Visual Simultaneous Localization and Mapping

Visual simultaneous localization and mapping (vSLAM).

Basics

Coordinate Systems

Specify pixel Indices, spatial coordinates, and 3-D coordinate systems

Point Feature Types

Choose functions that return and accept points objects for several types of features

Local Feature Detection and Extraction

Learn the benefits and applications of local feature detection and extraction

Structure from Motion

Estimate three-dimensional structures from two-dimensional image sequences

Computer Vision Toolbox Documentation

Support