Text Analysis

The Wolfram Language includes increasingly sophisticated tools for analyzing and visualizing text, both structurally and semantically.

Sources of Text

(RefLink[WordCount, paclet:ref/WordCount]) — total number of words in a text

(RefLink[WordCounts, paclet:ref/WordCounts]) — count of words or n-grams

(RefLink[WordFrequency, paclet:ref/WordFrequency]) — frequency of words or n-grams

(RefLink[Sort, paclet:ref/Sort]) — sort into alphabetical order

(RefLink[Classify, paclet:ref/Classify]) — classify strings based on training data or built-in classifiers

(RefLink[Nearest, paclet:ref/Nearest]) — find the closest-matching string from a list

(RefLink[FindClusters, paclet:ref/FindClusters]) — find clusters in string data

(RefLink[Dendrogram, paclet:ref/Dendrogram]) — hierarchical plot of similarities

(RefLink[EditDistance, paclet:ref/EditDistance]) — edit or Levenshtein distance

(RefLink[LanguageIdentify, paclet:ref/LanguageIdentify]) — identify what language a text is in

(RefLink[WordFrequencyData, paclet:ref/WordFrequencyData]) — data on word frequencies in typical current and historical text

(RefLink[SemanticImport, paclet:ref/SemanticImport]) — import text with semantic understanding

Text Visualization

(RefLink[Style, paclet:ref/Style]) — style text with color, font, or size

(RefLink[WordCloud, paclet:ref/WordCloud]) — generate a word cloud from word frequencies or weights

(RefLink[Snippet, paclet:ref/Snippet]) — extract a snippet of text

(RefLink[StringPartition, paclet:ref/StringPartition]) — partition a string into equal-size blocks

(RefLink[InsertLinebreaks, paclet:ref/InsertLinebreaks]) — break a string onto multiple lines

Text Parsing

(RefLink[TextStructure, paclet:ref/TextStructure]) — parse text into its grammatical structure

(OrangeLink[Text Comparison », paclet:guide/SequenceAlignmentAndComparison])

Content Analysis

(RefLink[TextContents, paclet:ref/TextContents]) — generate a dataset of identified elements in text

Content Extraction

(RefLink[TextCases, paclet:ref/TextCases]) — extract symbolically specified elements

(RefLink[TextPosition, paclet:ref/TextPosition]) — positions of symbolically specified elements

(RefLink[FindTextualAnswer, paclet:ref/FindTextualAnswer]) — attempt to find answers to questions from text

(OrangeLink[Text Normalization », paclet:guide/TextNormalization])