Nearest Neighbors

k nearest neighbors classification using Kd-tree search

To train a k-nearest neighbors model, use the Classification Learner app. For greater flexibility, train a k-nearest neighbors model using fitcknn in the command-line interface. After training, predict labels or estimate posterior probabilities by passing the model and predictor data to predict.

Apps

Classification LearnerTrain models to classify data using supervised machine learning

Functions

expand all

fitcknnFit k-nearest neighbor classifier
ExhaustiveSearcherCreate exhaustive nearest neighbor searcher
KDTreeSearcherCreate Kd-tree nearest neighbor searcher
creatensCreate nearest neighbor searcher object
crossvalCross-validated k-nearest neighbor classifier
kfoldEdgeClassification edge for observations not used for training
kfoldLossClassification loss for observations not used for training
kfoldfunCross validate function
kfoldMarginClassification margins for observations not used for training
kfoldPredictPredict response for observations not used for training
lossLoss of k-nearest neighbor classifier
resubLossLoss of k-nearest neighbor classifier by resubstitution
compareHoldoutCompare accuracies of two classification models using new data
edgeEdge of k-nearest neighbor classifier
marginMargin of k-nearest neighbor classifier
partialDependenceCompute partial dependence
plotPartialDependenceCreate partial dependence plot (PDP) and individual conditional expectation (ICE) plots
resubEdgeEdge of k-nearest neighbor classifier by resubstitution
resubMarginMargin of k-nearest neighbor classifier by resubstitution
predictPredict labels using k-nearest neighbor classification model
resubPredictPredict resubstitution labels of k-nearest neighbor classifier
pdistPairwise distance between pairs of observations
pdist2Pairwise distance between two sets of observations

Objects

expand all

ClassificationKNNk-nearest neighbor classification
ClassificationPartitionedModelCross-validated classification model

Topics

Train Nearest Neighbor Classifiers Using Classification Learner App

Create and compare nearest neighbor classifiers, and export trained models to make predictions for new data.

Visualize Decision Surfaces of Different Classifiers

This example shows how to visualize the decision surface for different classification algorithms.

Supervised Learning Workflow and Algorithms

Understand the steps for supervised learning and the characteristics of nonparametric classification and regression functions.

Classification Using Nearest Neighbors

Categorize data points based on their distance to points in a training data set, using a variety of distance metrics.

Related Information

Statistics and Machine Learning Toolbox Documentation

Support