ggml

12 progetti condividono questo topic GitHub

Le linee collegano membri che sono misurabilmente correlati tra loro. La dimensione dei punti riflette le stelle.

🧬 Membri

LLM inference in C/C++

llama and other large language models on iOS and MacOS offline using GGML library.

Go manage your Ollama models

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ComfyUI-MultiGPU

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU…

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Self-evaluating interview for AI coders

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

CLIP inference in plain C/C++ with no extra dependencies

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B…

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

🔗 Famiglie affini

language-model 75 gpt-2 13 gguf 9 gpu 51 huggingface 50 comfyui 86 comfyui-nodes 9 comfyui-workflow 6

Misurato dai temi di GitHub condivisi da entrambi i progetti, ponderato in base a quanto è raro ciascun tema.