Max Zanoga (@zanoga), the builder behind the well-known 32-GPU home AI datacenter, has launched a new project called ModelBay. The goal is straightforward: make sure open-source AI models stay available to everyone, even if governments or companies start to restrict them.
The timing is not an accident. In June 2026 the US government used export controls to pull Anthropic's Fable 5 and Mythos 5 models offline worldwide, and OpenAI released its GPT-5.6 model only to a small group of government-approved partners. Both moves followed a new executive order that set up government review of the most capable models before they ship. For now these controls apply to closed frontier models, but Max Zanoga argues that open weights could be next, and that the community should prepare before it happens rather than after.
ModelBay is a plan to keep open models reachable without depending on any single company, website, or country. It has four parts:
- Peer-to-peer distribution. Model weights are shared over BitTorrent instead of through a single host, the same way the first Llama and Mistral releases spread. A public list of file hashes lets anyone confirm they downloaded the real weights and not a tampered copy.
- Library and documentation backups. Running a model takes more than the weights. ModelBay keeps Git backups of the inference libraries, quantization tools, configs, and documentation needed to rebuild the full stack from scratch.
- A Tor mirror. A copy that is hard to take down, so the trackers and resources stay reachable even if the normal versions get blocked.
- Shared compute (planned). A future pool where people contribute a small slice of idle GPU time to run models for the community. Max Zanoga plans to start by sharing his own 32x RTX 3090 cluster when it sits idle.
Max Zanoga is well known in the local-LLM community for documenting his build from two GPUs to a 32-card cluster with 768GB of VRAM, running state-of-the-art open models locally on solar power. ModelBay comes out of that same hands-on work. He started thinking about peer-to-peer distribution after watching Hugging Face, where most people download their models, go offline more than once.
The weights-distribution piece is already under active development. Max Zanoga is now asking the open-source community for honest feedback on the idea, and wants to know how many people would be willing to keep and share hundreds of gigabytes of model weights to make the network work. The more people who take part, the stronger and harder to block the network becomes.

No comments:
Post a Comment