Frontier Engineering
Classical AI, NLP & Linguistics

TF-IDF

Also known as: TF-IDF, term frequency-inverse document frequency

TF-IDF is a numerical statistic that weighs the importance of a term within a document relative to a corpus. The term-frequency component scores how often a word appears in the document; the inverse-document-frequency component discounts words that appear in many documents, down-weighting common words like articles and prepositions. Multiplying the two components yields scores that highlight words distinctive to a particular document, making TF-IDF a robust feature representation for text classification and information retrieval.