ggml

12 projetos partilham este topic do GitHub

Linhas conectam membros que estão mensuravelmente relacionados entre si. O tamanho do ponto reflete estrelas.

🧬 Membros

LLM inference in C/C++

llama and other large language models on iOS and MacOS offline using GGML library.

Go manage your Ollama models

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

ComfyUI-MultiGPU

This custom_node for ComfyUI adds one-click "Virtual VRAM" for any UNet and CLIP loader as well MultiGPU…

Suno AI's Bark model in C/C++ for fast text-to-speech generation

Self-evaluating interview for AI coders

Port of MiniGPT4 in C++ (4bit, 5bit, 6bit, 8bit, 16bit CPU inference with GGML)

CLIP inference in plain C/C++ with no extra dependencies

C++ ggml runtime hub for multilingual ASR and TTS models: Cohere Transcribe, Parakeet TDT, Voxtral, Canary 1B…

LLaMA-Cult-and-More

Large Language Models for All, 🦙 Cult and More, Stay in touch !

🔗 Familias relacionadas

language-model 75 gpt-2 13 gguf 9 gpu 51 huggingface 50 comfyui 86 comfyui-nodes 9 comfyui-workflow 6

Medido a partir dos tópicos do GitHub compartilhados por ambos os projetos, ponderado pela raridade de cada tópico.