LARRUZFounder | Author & Creator of BYOAI

This New AI Remembers EVERYTHING

22 Jan 2025 · 1 min

Watch on YouTube

0:52

Short YouTube tech commentary describing Minimax01 (Minimax), a leading AI video-generator company that has released an LLM accessible via Hyluo AI. The presenter emphasizes the model’s unusually large context window (claimed 4 million tokens vs. ChatGPT’s 128k) and reports a perfect score on a ‘needle-in-a-haystack’ retrieval benchmark demonstrating flawless retrieval of small pieces of information in long documents.

Questions this video answers

4 million tokens.

128,000 tokens.

On the Hyluo AI website.

It achieved a perfect score (flawless retrieval).

Chapters

Minimax01 actually now has LLMs and yeah, this is Minimax, one of the top tier AI video generators. That's at least where you might know them from. But now they're also entering the arena of LLMs and they actually released something really capable here that you can use for free on their website Hyluo AI. But the big difference with this model is that it now has actually the world's longest context retention with 4 million tokens. If you're using ChatGPT it's 128,000 tokens using that's essentially how much info you can put into it before it gets amnesia and just forgets what happened at the top of your conversation. I found one thing particularly interesting and that is a perfect score on the needle in a haystack benchmark which essentially hides a little piece of information inside of a long document and then tests how well the LLM retrieves this. Usually other LLMs are not perfect at this like they're usually very good, but little pieces of context do get lost from attached documents. This one is flawless.