Learn to run Deepseek-R1, an open-source AI model, for free using Ollama and n8n. The 1.5B parameter model is much smaller than GPT-4's 1.8 trillion, but the gap with proprietary models is closing. Set it up locally in Docker and connect it to n8n workflows without paying for API access.
Here's how you run AI models in NN for free. So you're going to go to olama.com. I'll put the link in the description, and you don't have to even come here and download anything. Just go here, click on models, and now we have all of the different models that we can actually download and start using with our NN AI agents. And just to show you guys an example, let's do Deepseek R1, which is a thinking model. And all we're going to do is we're going to click on it, and now we have a few things to look at. So first of all, we have the different parameters that the open source version of Deepseek are offered in. So we've got 1.5 billion, 7 billion, 8 billion. And just for reference, these are pretty tiny. GPT-4 is 1.8 trillion almost, which is just massive. Claude 3.5 Sonnet is around 175 billion. So these closed source models are going to be much faster and more powerful than most of these open source ones. That gap is slowly closing, and one day there will be open source models that are just as powerful as these. But right now, that is the sort of limitation of open source models. And you're also going to be limited based on the actual local machine that you're going to be installing and running these models on. So I'm just copying the name deepseek-r1:1.5b. I'm going to open up our Docker and what I'm going to do is basically just open up the Ollama container and I'm just going to type ollama pull. I'm just going to paste in what we just copied, which was deepseek-r1. I'm going to go back into our local NN and open up this Ollama node. And now if I click this arrow, we see deepseek-r1 right here. And now we're no longer accessing our local Ollama model. We're using our local deepseek-r1. If you want to watch the full video, click on that play button right here and I'll see you guys over there.
