ggml

12 projets partagent ce topic GitHub

Les traits relient les membres réellement apparentés entre eux. La taille des points suit les étoiles.

🧬 Membres

LLM inference in C/C++

llama and other large language models on iOS and MacOS offline using GGML library.

Go manage your Ollama models

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ComfyUI-MultiGPU

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU…

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Self-evaluating interview for AI coders

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

CLIP inference in plain C/C++ with no extra dependencies

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B…

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

🔗 Familles voisines

language-model 75 gpt-2 13 gguf 9 gpu 51 huggingface 50 comfyui 86 comfyui-nodes 9 comfyui-workflow 6

Mesuré à partir des topics GitHub communs aux deux projets, pondérés par leur rareté.