LARRUZ shows how to network Mac minis into an AI supercomputer using new GitHub software. Four M4 Pro units can run 70B and 405B models that choke a single machine. Setup instructions are in the GitHub README.
If you wanted a AI supercomputer you needed tens of thousands of dollars just a few weeks ago. Now with this new software you could just buy a few Mac minis and plug them into each other. Now if you haven't seen the release, the brand new Mac minis are actually impressive with the M4 Pro processors they're unbelievable value for the money that they cost. And just the Mac mini overall happens to be really efficient when it comes to running LLMs. But a single Mac mini is not going to run some of the bigger models like the 70B models and here they even say it can run the llama 405B model but if you daisy chain four of them it works. Now the piece of software that does this freely available on GitHub. So anybody who wants to do this and buy multiple Mac minis just go into the readme here, follow these instructions or copy paste them into ChatGPT and let it guide you through it and you're going to be able to hook up multiple Mac minis and build a supercomputer.
