Cortex

Ollama-style runtime from the Jan team
Run LLMs locallyLocal runtime (CLI)Apache-2.0Runs locallyC++Beginner
OSAI Pulse ⓘ ★★★★★★★★★★ /100 signals tracked
🐳 Docker pulls 📦 PyPI downloads / month 📦 npm downloads / month 🚀 Latest release ·
Visit website →View on GitHub

What is Cortex?

Cortex is a local AI engine with a simple CLI, an OpenAI-compatible API and multiple backends (llama.cpp, TensorRT-LLM), designed to power the Jan desktop app or run standalone.

Why people choose Cortex

Cortex at a glance

CategoryRun LLMs locally
TypeLocal runtime (CLI)
LicenseApache-2.0
Runs locallyYes
Built withC++
Skill levelBeginner
Best fora clean Ollama alternative with swappable engines

Open-source alternatives to Cortex

Other open-source run llms locally tools worth comparing:

OllamaRun open LLMs locally from one commandLM StudioBrowse, download and chat with local modelsJanOpen-source, offline ChatGPT-style desktop appGPT4AllPrivate local AI that runs on CPUllama.cppThe C/C++ engine powering local inferenceLocalAIA drop-in OpenAI API you self-hostText Generation WebUIFeature-rich web UI for local modelsKoboldCppSingle-file local model runnerMLC LLMRun LLMs on any device, even phonesllamafileOne executable file = model + runtimeexoRun big models across your everyday devicesNexa SDKRun any model on any device — CPU, GPU, NPURamaLamaRun models as OCI containersGPUStackManage GPU clusters for running models

Cortex head-to-head

Cortex vs OllamaCortex vs LM StudioCortex vs JanCortex vs GPT4AllCortex vs llama.cppCortex vs LocalAICortex vs Text Generation WebUICortex vs KoboldCppCortex vs MLC LLMCortex vs llamafileCortex vs exoCortex vs Nexa SDKCortex vs RamaLamaCortex vs GPUStack

FAQ

Is Cortex free?

Cortex is free and open-source (Apache-2.0 license), so you can use, self-host and modify it at no cost.

Can I run Cortex locally?

Yes. Cortex is designed to run on your own machine or server, keeping your data private.

What is the best alternative to Cortex?

Popular open-source alternatives include Ollama, LM Studio, Jan. See the comparisons above to choose.

Explore more open-source AI

Browse the full directory of open-source AI tools, models and projects — updated daily.

Browse all tools →