knowledge-distillation

8 projects share this GitHub topic

knowledge-distillation — Pretrained-Language-Model ★3.2kknowledge-distillationVLM_survey — ★3.1kai-knowledge-graph — ★2.5kEasyNLP — ★2.2kAwesome-Efficient-LLM — ★2kdistill-sd — ★618easydistill — ★436RKD — ★419VLM_survey★ 3.1kai-knowledge-graph★ 2.5kEasyNLP★ 2.2kAwesome-Efficient-LLM★ 2kdistill-sd★ 618easydistill★ 436RKD★ 419

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members
Pretrained-Language-Model
Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
★ 3.2k
VLM_survey
Collection of AWESOME vision-language models for vision tasks
★ 3.1k
ai-knowledge-graph
AI Powered Knowledge Graph Generator
★ 2.5k
EasyNLP
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
★ 2.2k
Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
★ 2k
distill-sd
Segmind Distilled diffusion
★ 618
easydistill
a toolkit on knowledge distillation for large language models
★ 436
RKD
Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
★ 419
🔗 Related families
model-compression 6clip 39knowledge-graph 25bert 81compression 20language-model 75distillation 15inference 46

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.