Richie CottonSenior Data Evangelist, DataCamp · Ask me about data and AI upskilling

Coining the term LLM Router - Pioneering in #ai

Name: Coining the term LLM Router - Pioneering in #ai
Uploaded: 2024-07-15T16:40:50+00:00
Duration: 41 s
Channel: Richie Cotton
Description: A client proposed building specialized AI models for different knowledge domains like calculus and number theory, with a supervisory layer routing…

15 Jul 2024 · 1 min

Watch on YouTube

0:41

A client proposed building specialized AI models for different knowledge domains like calculus and number theory, with a supervisory layer routing queries to the right one. The approach, called an LLM router, applies existing ideas from mixture-of-experts and multi-agent systems to practical problems.

Chapters

So it started with one I would call sub LLM. And then for instance, the Wolfram website. Like I said, it's 15 categories. Calculus is another one, number theory is another one. So you could create 15 different sub LLMs, then have a system on top of it that managed all the LLMs. So one of my clients actually invented or coined the word LLM router to manage those LLM. You might have heard words like mixture of experts, multi agent systems that are related to this idea of managing these different LLMs.