quantization

6 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

faster-whisper

Faster Whisper transcription with CTranslate2

★ 24.3k

GPTQModel

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and…

★ 1.2k

OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

★ 901

QeRL

[ICLR 2026]QeRL enables RL for 32B LLMs on a single H100 GPU.

★ 511

PiSSA

PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024…

★ 430

BitNet-Transformers

0️⃣1️⃣🤗 BitNet-Transformers: Huggingface Transformers Implementation of "BitNet: Scaling 1-bit…

★ 316

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.