Classification Trees

Binary decision trees for multiclass learning

To interactively grow a classification tree, use the Classification Learner app. For greater flexibility, grow a classification tree using fitctree at the command line. After growing a classification tree, predict labels by passing the tree and new predictor data to predict.

Apps

Classification LearnerTrain models to classify data using supervised machine learning

Functions

expand all

fitctreeFit binary decision tree for multiclass classification
compactCompact tree
pruneProduce sequence of classification subtrees by pruning
cvlossClassification error by cross validation
partialDependenceCompute partial dependence
plotPartialDependenceCreate partial dependence plot (PDP) and individual conditional expectation (ICE) plots
predictorImportanceEstimates of predictor importance for classification tree
surrogateAssociationMean predictive measure of association for surrogate splits in classification tree
viewView classification tree
crossvalCross-validated decision tree
kfoldEdgeClassification edge for observations not used for training
kfoldLossClassification loss for observations not used for training
kfoldfunCross validate function
kfoldMarginClassification margins for observations not used for training
kfoldPredictPredict response for observations not used for training
lossClassification error
resubLossClassification error by resubstitution
compareHoldoutCompare accuracies of two classification models using new data
edgeClassification edge
marginClassification margins
resubEdgeClassification edge by resubstitution
resubMarginClassification margins by resubstitution
predictPredict labels using classification tree
resubPredictPredict resubstitution labels of classification tree

Classes

ClassificationTreeBinary decision tree for multiclass classification
CompactClassificationTreeCompact classification tree
ClassificationPartitionedModelCross-validated classification model

Topics

Train Decision Trees Using Classification Learner App

Create and compare classification trees, and export trained models to make predictions for new data.

Supervised Learning Workflow and Algorithms

Understand the steps for supervised learning and the characteristics of nonparametric classification and regression functions.

Decision Trees

Understand decision trees and how to fit them to data.

Growing Decision Trees

To grow decision trees, fitctree and fitrtree apply the standard CART algorithm by default to the training data.

View Decision Tree

Create and view a text or graphic description of a trained decision tree.

Visualize Decision Surfaces of Different Classifiers

This example shows how to visualize the decision surface for different classification algorithms.

Splitting Categorical Predictors in Classification Trees

Learn about the heuristic algorithms for optimally splitting categorical variables with many levels while growing decision trees.

Improving Classification Trees and Regression Trees

Tune trees by setting name-value pair arguments in fitctree and fitrtree.

Prediction Using Classification and Regression Trees

Predict class labels or responses using trained classification and regression trees.

Predict Out-of-Sample Responses of Subtrees

Predict responses for new data using a trained regression tree, and then plot the results.