R tutorial: The TDM & DTM with text mining

10 Nov 2016 · 1 min
1:03

In this segment, the instructor explains the core data structures used for bag‑of‑words text mining in R. He defines the term‑document matrix (TDM) as a matrix where each unique word from a clean corpus occupies a row and each document occupies a column, typically holding word frequencies. He then describes the document‑term matrix (DTM) as the transpose of the TDM, with documents as rows and words as columns, created via a dedicated DTM function. The speaker notes that while the simplest matrices store raw word counts, other frequency weighting schemes exist, and mentions that the QDAT package operates on a word‑frequency matrix, though the tutorial does not delve into that less‑common format.

Chapters

More from Richie

youtube.com

#359 My Best Friend is AI with Valerie Tiberius, Professor of Philosophy at University of Minnesota

5mo ago
youtube.com

17.8% of the World Now Uses AI — And the Gap Is Widening | The Median #5

5mo ago
youtube.com

Create GPTs to Automate Go-To-Market Research

5mo ago
youtube.com

What Happened to Self-Driving Cars? #AI

5mo ago
youtube.com

Never Use AI For This #warning #AI #flights

5mo ago
youtube.com

Use AI Agents to Analyze Power Grid Optimization

5mo ago
youtube.com

This is how modern AI actually solves problems #AITrends #AI

5mo ago
youtube.com

How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon

5mo ago
youtube.com

#358 How AI Agents Will Work While You Sleep | Ruslan Salakhutdinov, Professor at Carnegie Mellon

5mo ago
youtube.com

Build an AI‑driven Dashboard

5mo ago
youtube.com

What’s Broken in Labor Markets Today #datascience

5mo ago
See all content