Text Manipulation

The Wolfram Language has uniquely flexible capabilities for processing textual data. It can operate at the level of strings and characters or at the level of words and sentences. It can also operate semantically, through its extensive built-in natural language understanding capabilities.

Text Acquisition

(RefLink[Import, paclet:ref/Import]) — import text from files or the web

(StringTypeLink["Text", paclet:ref/format/Text]), (StringTypeLink["PDF", paclet:ref/format/PDF]), (StringTypeLink["TeX", paclet:ref/format/TeX]), (StringTypeLink["HTML", paclet:ref/format/HTML]) — pick out plaintext, table data, etc.

(RefLink[NotebookImport, paclet:ref/NotebookImport]) — import text from a notebook

(RefLink[FindList, paclet:ref/FindList]) — search files for records containing particular strings

(RefLink[TextString, paclet:ref/TextString]) — convert arbitrary expressions to text

(RefLink[TextRecognize, paclet:ref/TextRecognize]) — extract text from images using OCR

(OrangeLink[Text Normalization », paclet:guide/TextNormalization])

(RefLink[DeleteStopwords, paclet:ref/DeleteStopwords]) — delete standard stopwords ("the", "and", etc.) from a string

(RefLink[StringSplit, paclet:ref/StringSplit]) — split a string at newlines or other delimiters

Structural Text Manipulation

(RefLink[TextCases, paclet:ref/TextCases]) — extract symbolically specified elements

(RefLink[TextSentences, paclet:ref/TextSentences]) — extract a list of sentences

(RefLink[TextWords, paclet:ref/TextWords]) — extract a list of words

(RefLink[SequenceAlignment, paclet:ref/SequenceAlignment]) — find matching sequences in text

(OrangeLink[Searching & Pattern Matching », paclet:guide/StringManipulation])

(RefLink[StringExpression, paclet:ref/StringExpression]) — general string pattern

(OrangeLink[Text Analysis », paclet:guide/TextAnalysis])

(RefLink[WordCounts, paclet:ref/WordCounts]) — count occurrences of words and n-grams

(RefLink[Classify, paclet:ref/Classify]) — classify strings based on training data or built-in classifiers

Natural Language Processing

(RefLink[LanguageIdentify, paclet:ref/LanguageIdentify]) — determine the language of a text

(RefLink[DictionaryLookup, paclet:ref/DictionaryLookup]) — look up words in English and other dictionaries

(RefLink[WordData, paclet:ref/WordData]) — find semantic, grammatical, morphological, etc. properties of words

(RefLink[TextStructure, paclet:ref/TextStructure]) — parse text into its grammatical structure

(RefLink[TextContents, paclet:ref/TextContents]) — generate a dataset of identified elements in text

(RefLink[SpellingCorrectionList, paclet:ref/SpellingCorrectionList]) — list of spelling suggestions for misspelled words

(OrangeLink[Natural Language Understanding », paclet:guide/InterpretingStrings])

(RefLink[Interpreter, paclet:ref/Interpreter]) — attempt to interpret strings of a wide variety of types

(OrangeLink[Text Generation », paclet:guide/TextConstruction])