exo
Run big models across your everyday devices
Run LLMs locallyDistributed home clusterGPL-3.0Runs locallyPythonIntermediate
🐳 Docker pulls
📦 PyPI downloads / month
📦 npm downloads / month
🚀 Latest release ·
What is exo?
exo turns the devices you already own — Macs, PCs, phones — into a self-organizing AI cluster, splitting large models across them with automatic peer discovery.
Why people choose exo
- Aggregates the memory of all your devices automatically
- ChatGPT-compatible API on your own cluster
- No expensive GPU server needed for large models
exo at a glance
| Category | Run LLMs locally |
| Type | Distributed home cluster |
| License | GPL-3.0 |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | running models too large for any single machine at home |
Latest releases
Open-source alternatives to exo
Other open-source run llms locally tools worth comparing:
OllamaRun open LLMs locally from one command
JanOpen-source, offline ChatGPT-style desktop app
GPT4AllPrivate local AI that runs on CPU
llama.cppThe C/C++ engine powering local inference
LocalAIA drop-in OpenAI API you self-host
Text Generation WebUIFeature-rich web UI for local models
KoboldCppSingle-file local model runner
MLC LLMRun LLMs on any device, even phones
llamafileOne executable file = model + runtimeCortexOllama-style runtime from the Jan team
Nexa SDKRun any model on any device — CPU, GPU, NPU
RamaLamaRun models as OCI containers
GPUStackManage GPU clusters for running modelsexo head-to-head
exo vs Ollamaexo vs LM Studioexo vs Janexo vs GPT4Allexo vs llama.cppexo vs LocalAIexo vs Text Generation WebUIexo vs KoboldCppexo vs MLC LLMexo vs llamafileexo vs Cortexexo vs Nexa SDKexo vs RamaLamaexo vs GPUStack
FAQ
Is exo free?
exo is free and open-source (GPL-3.0 license), so you can use, self-host and modify it at no cost.
Can I run exo locally?
Yes. exo is designed to run on your own machine or server, keeping your data private.
What is the best alternative to exo?
Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.
Explore more open-source AI
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →