Home Projects BitNet-Transformers
BitNet-Transformers

BitNet-Transformers

by Beomi · GitHub

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

# llm# quantization# quantization-aware-training# transformers
View on GitHub
⭐ Stars
316
🍴 Forks
35
📜 License
License not specified
📅 Created
2023
🔄 Last commit
2 yr ago
🏷️ Category
llm
💻 Language
🖥️ Self-hostable
Likely
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
BitNet-Transformers — GitHub preview card
📈 Star history
317316
2026-07-202026-07-21
📄 About

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Frequently asked questions

What is BitNet-Transformers?

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch with Llama(2) Architecture

Is BitNet-Transformers open source?

BitNet-Transformers is an open-source project.

Is BitNet-Transformers free?

Yes. BitNet-Transformers is free and open source — you can use, modify and self-host it.

🏅 Maintainer of this project?
OpenSourceAI badge — BitNet-Transformers

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![OpenSourceAI](https://opensourceai.tech/badge.php?tool=beomi-bitnet-transformers)](https://opensourceai.tech/project/beomi-bitnet-transformers.html)
More badge options →
🧬 Related projects🧬 View the DNA map →