efficient-inference

10 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

EfficientFormer

EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]

[CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

Awesome-Quantization-Papers

List of papers related to neural network quantization in recent AI conferences and journals.

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Fast, lossless LLM inference via dual-view diffusion decoding.

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Awesome-Generation-Acceleration

📚 Collection of awesome generation acceleration resources.

On-device LLM Inference Powered by X-Bit Quantization

speculative-decoding

Explorations into some recent techniques surrounding speculative decoding

🔗 Familias relacionadas

llama 65 compression 20 function-calling 14 detection 28 model-compression 6 stable-diffusion 118 edge-computing 10 image-generation 99

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.