Homeβ€Ί Projectsβ€Ί Awesome-LLM-Inference
Awesome-LLM-Inference

Awesome-LLM-Inference

by xlite-dev Β· GitHub

πŸ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.πŸŽ‰

View on GitHub
⭐ Stars
5.4k
🍴 Forks
427
πŸ”₯ Trending
+19 this week
πŸ“œ License
GPL-3.0
Copyleft license
πŸ“… Created
2023
πŸ”„ Last commit
27 days ago
🏷️ Category
awesome-llm
πŸ’» Language
You maintain this project?

Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.

Claim this page →
Awesome-LLM-Inference β€” GitHub preview card
πŸ“ˆ Star history
5.40k5.38k
2026-07-122026-07-21
πŸ“„ About

πŸ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.πŸŽ‰

Frequently asked questions

What is Awesome-LLM-Inference?

πŸ“šA curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.πŸŽ‰

Is Awesome-LLM-Inference open source?

Awesome-LLM-Inference is an open-source project. It is released under the GPL-3.0 license.

Is Awesome-LLM-Inference free?

Yes. Awesome-LLM-Inference is free and open source β€” you can use, modify and self-host it.

πŸ… Maintainer of this project?
OpenSourceAI badge β€” Awesome-LLM-Inference

Add this live badge to your README β€” your GitHub stars and directory rank, refreshed daily.

[![OpenSourceAI](https://opensourceai.tech/badge.php?tool=xlite-dev-awesome-llm-inference)](https://opensourceai.tech/project/xlite-dev-awesome-llm-inference.html)
More badge options β†’
🧬 Related projects🧬 View the DNA map β†’