Home Projects sndr_core_engine
sndr_core_engine

sndr_core_engine

by Sandermage · GitHub

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

# awq# consumer-gpu# cuda# gemma
View on GitHub
⭐ Stars
125
🍴 Forks
6
📜 License
Apache-2.0
Commercial use OK
📅 Created
2026
🔄 Last commit
today
🏷️ Category
awq
💻 Language
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
sndr_core_engine — GitHub preview card
📈 Star history
126125
2026-07-202026-07-21
📄 About

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

Frequently asked questions

What is sndr_core_engine?

SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/31B AWQ, 256K ctx. 321 patches: TurboQuant k8v4 KV, MTP/DFlash

Is sndr_core_engine open source?

sndr_core_engine is an open-source project. It is released under the Apache-2.0 license.

Is sndr_core_engine free?

Yes. sndr_core_engine is free and open source — you can use, modify and self-host it.

🏅 Maintainer of this project?
OpenSourceAI badge — sndr_core_engine

Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.

[![OpenSourceAI](https://opensourceai.tech/badge.php?tool=sandermage-sndr-core-engine)](https://opensourceai.tech/project/sandermage-sndr-core-engine.html)
More badge options →
🧬 Related projects🧬 View the DNA map →