Nexa SDK
Run any model on any device — CPU, GPU, NPU
Run LLMs locallyLocal runtime (SDK)Apache-2.0Runs locallyPythonIntermediate
🐳 Docker pulls
📦 PyPI downloads / month
📦 npm downloads / month
🚀 Latest release ·
What is Nexa SDK?
Nexa SDK runs text, vision, audio and image models locally across CPU, GPU and NPU backends, with a single unified API and OpenAI-compatible server.
Why people choose Nexa SDK
- Runs on NPUs, not just CPU and GPU
- One API for text, vision and audio models
- OpenAI-compatible local server
Nexa SDK at a glance
| Category | Run LLMs locally |
| Type | Local runtime (SDK) |
| License | Apache-2.0 |
| Runs locally | Yes |
| Built with | Python |
| Skill level | Intermediate |
| Best for | developers targeting many device types from one codebase |
Latest releases
Open-source alternatives to Nexa SDK
Other open-source run llms locally tools worth comparing:
OllamaRun open LLMs locally from one command
JanOpen-source, offline ChatGPT-style desktop app
GPT4AllPrivate local AI that runs on CPU
llama.cppThe C/C++ engine powering local inference
LocalAIA drop-in OpenAI API you self-host
Text Generation WebUIFeature-rich web UI for local models
KoboldCppSingle-file local model runner
MLC LLMRun LLMs on any device, even phones
llamafileOne executable file = model + runtime
exoRun big models across your everyday devicesCortexOllama-style runtime from the Jan team
RamaLamaRun models as OCI containers
GPUStackManage GPU clusters for running modelsNexa SDK head-to-head
Nexa SDK vs OllamaNexa SDK vs LM StudioNexa SDK vs JanNexa SDK vs GPT4AllNexa SDK vs llama.cppNexa SDK vs LocalAINexa SDK vs Text Generation WebUINexa SDK vs KoboldCppNexa SDK vs MLC LLMNexa SDK vs llamafileNexa SDK vs exoNexa SDK vs CortexNexa SDK vs RamaLamaNexa SDK vs GPUStack
FAQ
Is Nexa SDK free?
Nexa SDK is free and open-source (Apache-2.0 license), so you can use, self-host and modify it at no cost.
Can I run Nexa SDK locally?
Yes. Nexa SDK is designed to run on your own machine or server, keeping your data private.
What is the best alternative to Nexa SDK?
Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.
Explore more open-source AI
Browse the full directory of open-source AI tools, models and projects — updated daily.
Browse all tools →