Tim Davies explains how large language models work: they're trained on massive amounts of text from books, the web, and Wikipedia, then learn statistical patterns to generate fluent responses. ChatGPT is the public face of this technology.
LLMs?
Yeah. Large Language models.
So what is an LLM?
Large Language model is taking that transformer model and feeding it unbelievably large amounts of data. Think all of the books in the world, all of the content from the Internet that isn't on 4chan and porn channels, packaging that up Wikipedia data and feeding it in and then having this algorithm learn and absorb all of this information effectively build connections between synapses, although it's really just weights within a monster spreadsheet. And then that process, when it's run on computers at scale, can be asked a question and based on that training can answer the question with the context and with its understanding of the connection of words to give compelling English or any other language or any other type of response, depending on whether it's a large language model or something else.
Okay, that makes sense. And I think one of the still one of the most used and sort of synonymous terms when we talk About LLMs is chatgpt. It's been around for 18 months now. It was the original. As far as most public facing models.
Go, I would say it was the original application.
Yes.
The models had existed for quite some time before them.
Okay.
EP 60: Why Founders Become the Bottleneck — And How AI Changes Everything | Thea Brook
