ggml

12 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

LLM inference in C/C++

llama and other large language models on iOS and MacOS offline using GGML library.

Go manage your Ollama models

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ComfyUI-MultiGPU

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU…

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Self-evaluating interview for AI coders

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

CLIP inference in plain C/C++ with no extra dependencies

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B…

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

🔗 Related families

language-model 75 gpt-2 13 gguf 9 gpu 51 huggingface 50 comfyui 86 comfyui-nodes 9 comfyui-workflow 6

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.