Matt Wolfe walks through running the Qwen 3.8 27B model locally using LM Studio. He shows where to find it on Hugging Face, explains quantization options from 4-bit to 8-bit, and recommends choosing the highest bit your computer can handle. Local models keep improving while shrinking in size.
Quinn 3.8 27B is a 27 billion parameter variant that you actually can run on consumer-grade computers. If you do want to run it locally, the easiest way that I've found is to download LM Studio here. It's a totally free app. You could come over here to the model search, search for Quinn 3.8, and this is the official version straight from Quinn on Hugging Face. You can get 4-bit, 5-bit, 6-bit, and 8-bit quantization. Now that just means like the amount of compression essentially on it. The more quantized it is, you're So you wanna run the best one that your computer will let you run, the highest bit. The nice thing about LM Studio here is that if you click on any one of these models or variations, it'll tell you if it'll run on your computer. Once you have that model downloaded, you can click on My Models. So if I select Uncensored, click on my little cog icon, and then click Use in New Chat, you can see it then pulls in that model. And now I can use this model completely uncensored in chat, and it will think, it will use code, it will do all the things that it normally does. It will pretty much do anything you expect new models to do. The major idea here is that these local models are getting better and better, even though they're getting smaller and smaller in terms of like parameter count and actual file size and the amount of compute required to run them.
AI News: Dots, GPT-6.1 Sol, Sonnet 5.5, Gemini 4, and everything you need to know
