Awesome-Knowledge-Distillation-of-LLMs
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
What is Awesome-Knowledge-Distillation-of-LLMs?
This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.
Is Awesome-Knowledge-Distillation-of-LLMs open source?
Awesome-Knowledge-Distillation-of-LLMs is an open-source project.
Is Awesome-Knowledge-Distillation-of-LLMs free?
Yes. Awesome-Knowledge-Distillation-of-LLMs is free and open source — you can use, modify and self-host it.
Add this live badge to your README — your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/tebmer-awesome-knowledge-distillation-of-llms.html)
