Choose a Sensor for 3D Simulation

You can use the 3D simulation environment in Automated Driving Toolbox™ to obtain high-fidelity sensor data. This environment is rendered using the Unreal Engine® from Epic Games®.

The table summarizes the sensor blocks that you can simulate in this environment.

Sensor BlockDescriptionVisualizationExample

Simulation 3D Camera

  • Camera with lens that is based on the ideal pinhole camera. See What Is Camera Calibration? (Computer Vision Toolbox)

  • Includes parameters for image size, focal length, distortion, and skew

  • Includes options to output ground truth for depth estimation and semantic segmentation

Display camera images by using a Video Viewer or To Video Display block. Sample visualization:

Design of Lane Marker Detector in 3D Simulation Environment

Display depth maps by using a Video Viewer or To Video Display block. Sample visualization:

Visualize Depth and Semantic Segmentation Data in 3D Environment

Display semantic segmentation maps by using a Video Viewer or To Video Display block. Sample visualization:

Visualize Depth and Semantic Segmentation Data in 3D Environment

Simulation 3D Fisheye Camera

  • Fisheye camera that can be described using the Scaramuzza camera model. See Fisheye Calibration Basics (Computer Vision Toolbox)

  • Includes parameters for distortion center, image size, and mapping coefficients

Display camera images by using a Video Viewer or To Video Display block. Sample visualization:

Simulate a Simple Driving Scenario and Sensor in 3D Environment

Simulation 3D Lidar

  • Scanning lidar sensor model

  • Includes parameters for detection range, resolution, and fields of view

Display point cloud data by using pcplayer within a MATLAB Function block. Sample visualization:

Simulate Lidar Sensor Perception Algorithm

Display lidar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Visualize 3D Simulation Sensor Coverages and Detections

Simulation 3D Probabilistic Radar

  • Probabilistic radar model that returns a list of detections

  • Includes parameters for radar accuracy, radar bias, detection probability, and detection reporting

Display radar coverage areas and detections by using the Bird's-Eye Scope. Sample visualization:

Simulate Radar Sensors in 3D Environment

Visualize 3D Simulation Sensor Coverages and Detections

See Also

Blocks

Related Topics