Deep Learning for Image Processing

Perform image processing tasks, such as removing image noise and creating high-resolution images from low-resolutions images, using convolutional neural networks (requires Deep Learning Toolbox™)

Deep learning uses neural networks to learn useful representations of features directly from data. For example, you can use a pretrained neural network to identify and remove artifacts like noise from images.

Functions

expand all

augmentedImageDatastoreTransform batches to augment image data
bigimageDatastoreDatastore to manage blocks of big image data
denoisingImageDatastoreDenoising image datastore
imageDatastoreDatastore for image data
randomPatchExtractionDatastoreDatastore for extracting random 2-D or 3-D random patches from images or pixel label images
transformTransform datastore
combineCombine data from multiple datastores
jitterColorHSVRandomly alter color of pixels
centerCropWindow2dCreate rectangular center cropping window
centerCropWindow3dCreate cuboidal center cropping window
randomCropWindow2dCreate randomized rectangular cropping window
randomCropWindow3dCreate randomized cuboidal cropping window
RectangleSpatial extents of 2-D rectangular region
CuboidSpatial extents of 3-D cuboidal region
randomAffine2dCreate randomized 2-D affine transformation
randomAffine3dCreate randomized 3-D affine transformation
affineOutputViewCreate output view for warping images
resize2dLayer2-D resize layer
resize3dLayer3-D resize layer
dlresizeResize spatial dimensions of dlarray
denoiseImageDenoise image using deep neural network
denoisingNetworkGet image denoising network
dnCNNLayersGet denoising convolutional neural network layers

Topics

Preprocess Images for Deep Learning

Datastores for Deep Learning (Deep Learning Toolbox)

Learn how to use datastores in deep learning applications.

Augment Images for Deep Learning Workflows Using Image Processing Toolbox (Deep Learning Toolbox)

This example shows how MATLAB® and Image Processing Toolbox™ can perform common kinds of image augmentation as part of deep learning workflows.

Preprocess Images for Deep Learning (Deep Learning Toolbox)

Learn how to resize images for training, prediction, and classification, and how to preprocess images using data augmentation, transformations, and specialized datastores.

Preprocess Volumes for Deep Learning (Deep Learning Toolbox)

Read and preprocess volumetric image and label data for 3-D deep learning.

Denoise Images Using Deep Learning

Train and Apply Denoising Neural Networks

Use a pretrained neural network to remove Gaussian noise from a grayscale image, or train your own network using predefined layers.

Remove Noise from Color Image Using Pretrained Neural Network

This example shows how to remove Gaussian noise from an RGB image by using a pretrained denoising neural network on each color channel independently.

Prepare Datastore for Image-to-Image Regression (Deep Learning Toolbox)

This example shows how to prepare a datastore for training an image-to-image regression network using the transform and combine functions of ImageDatastore.

Deep Learning in MATLAB

Deep Learning in MATLAB (Deep Learning Toolbox)

Discover deep learning capabilities in MATLAB® using convolutional neural networks for classification and regression, including pretrained networks and transfer learning, and training on GPUs, CPUs, clusters, and clouds.

Pretrained Deep Neural Networks (Deep Learning Toolbox)

Learn how to download and use pretrained convolutional neural networks for classification, transfer learning and feature extraction.

Semantic Segmentation Using Deep Learning (Computer Vision Toolbox)

This example shows how to train a semantic segmentation network using deep learning.

List of Deep Learning Layers (Deep Learning Toolbox)

Discover all the deep learning layers in MATLAB.

Featured Examples

Single Image Super-Resolution Using Deep Learning

Single Image Super-Resolution Using Deep Learning

Create a high-resolution image from a single low-resolution image, by using the Very-Deep Super-Resolution (VDSR) deep learning algorithm.

Open Live Script
JPEG Image Deblocking Using Deep Learning

JPEG Image Deblocking Using Deep Learning

Remove JPEG compression artifacts from an image, by using a deep convolutional neural network trained with residual images.

Open Live Script
Image Processing Operator Approximation Using Deep Learning

Image Processing Operator Approximation Using Deep Learning

Use a deep neural network to process an image such that the resulting image resembles the output from a bilateral filter.

Open Live Script
Develop Raw Camera Processing Pipeline Using Deep Learning

Develop Raw Camera Processing Pipeline Using Deep Learning

Use a U-Net network to approximate a typical pipeline of image processing operations that convert raw camera data to an aesthetically pleasing image.

Open Live Script
Deep Learning Classification of Large Multiresolution Images

Deep Learning Classification of Large Multiresolution Images

Train an Inception-v3 deep neural network to classify multiresolution whole slide images (WSIs) that do not fit in memory.

Open Live Script
Semantic Segmentation of Multispectral Images Using Deep Learning

Semantic Segmentation of Multispectral Images Using Deep Learning

Use a deep neural network to perform semantic segmentation of an image with data in seven channels: three infrared channels, RGB color channels, and a mask channel.

Open Live Script
3-D Brain Tumor Segmentation Using Deep Learning

3-D Brain Tumor Segmentation Using Deep Learning

Train a 3-D U-Net neural network and perform semantic segmentation of brain tumors from 3-D medical images. The example shows how to train a 3-D U-Net network and also provides a pretrained network. Use of a CUDA-capable NVIDIA™ GPU with compute capability 3.0 or higher is highly recommended for 3-D semantic segmentation (requires Parallel Computing Toolbox™).

Open Live Script
Neural Style Transfer Using Deep Learning

Neural Style Transfer Using Deep Learning

Apply the stylistic appearance of one image to the scene content of a second image using a pretrained VGG-19 network [1]. This example uses the distinctive Van Gogh painting "Starry Night" as the style image and a photograph of a lighthouse as the content image.

Open Live Script

Image Processing Toolbox Documentation

Support