lm-evaluation-harness
by EleutherAI · GitHub
A framework for few-shot evaluation of language models.
⭐ Stars
13.3k
🍴 Forks
3.4k
🔥 Trending
+75 this week
📜 License
MIT
Commercial use OK📅 Created
2020
🔄 Last commit
7 days ago
🏷️ Category
evaluation-framework
💻 Language
You maintain this project?
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
📈 Star history
2026-07-122026-07-21
📄 About
A framework for few-shot evaluation of language models.
❓ Frequently asked questions
What is lm-evaluation-harness?
A framework for few-shot evaluation of language models.
Is lm-evaluation-harness open source?
lm-evaluation-harness is an open-source project. It is released under the MIT license.
Is lm-evaluation-harness free?
Yes. lm-evaluation-harness is free and open source — you can use, modify and self-host it.
🏅 Maintainer of this project?
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/eleutherai-lm-evaluation-harness.html)
🧬 Related projects🧬 View the DNA map →
