Nvidia quietly released a Windows chatbot app that runs locally on GeForce RTX 30/40-series GPUs. It supports open-source models, lets you upload files for retrieval-augmented generation, and can chat with YouTube videos. The move signals Nvidia's push into vertical integration of hardware, software, and AI.
Windows
NVIDIA GeForce RTX 30-series or 40-series GPUs
February 23, 2024
Nvidia just silently released an app that allows you to run a ChatGPT like application on your computer. Here's what you need to know. Now, unfortunately, this is Windows only. And it's not just that you need Windows, you also need a concrete graphics card. So concretely, you need the GeForce RTX 30 and 40 series GPUs. But basically Nvidia brought out a chat interface. So this is big because they're starting to move into the direction of full vertical integration, right? As of now, they dominate the hardware space and the software front. They have a lot of research, but so far they didn't really have a competitor or something like ChatGPT. So far, this is their first step in that direction. Your personalized AI chatbot. So it's very interesting to me that they entered the arena with a software product like this because now you can use all the open source models in there. And as those get better and their hardware gets better and the software gets better, well, you're going to be able to get everything you need from Nvidia themselves. I mean, you can upload local files and via rag chat with those. You can chat with YouTube videos. Those are some of the most important features for large language models.
