⭐ Stars
12k
🍴 Forks
20.5k
📜 License
MIT
Commercial use OK📅 Created
2023
🔄 Last commit
today
🏷️ Category
ggml
💻 Language
C++
🖥️ Self-hostable
Likely
📈 Star history
📊 Star history will build up here over the coming days (1 data point recorded so far).
📄 About
LLM inference in C/C++
Read the full guide❓ Frequently asked questions
What is llama.cpp?
LLM inference in C/C++
Is llama.cpp open source?
llama.cpp is an open-source project. It is released under the MIT license.
Is llama.cpp free?
Yes. llama.cpp is free and open source — you can use, modify and self-host it.
🏅 Maintainer of this project?
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/ggml-org-llama-cpp.html)