R tutorial: The TDM & DTM with text mining
10 Nov 2016 · 1 min

1:03
In this segment, the instructor explains the core data structures used for bag‑of‑words text mining in R. He defines the term‑document matrix (TDM) as a matrix where each unique word from a clean corpus occupies a row and each document occupies a column, typically holding word frequencies. He then describes the document‑term matrix (DTM) as the transpose of the TDM, with documents as rows and words as columns, created via a dedicated DTM function. The speaker notes that while the simplest matrices store raw word counts, other frequency weighting schemes exist, and mentions that the QDAT package operates on a word‑frequency matrix, though the tutorial does not delve into that less‑common format.










