paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Claim its page: indexed whatever its rank, translated into six languages, and enriched with what you write yourself.
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
What is paddler?
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale ππ¦ Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
Is paddler open source?
paddler is an open-source project. It is released under the Apache-2.0 license.
Is paddler free?
Yes. paddler is free and open source β you can use, modify and self-host it.
Add this live badge to your README β your GitHub stars and directory rank, refreshed daily.
[](https://opensourceai.tech/project/intentee-paddler.html)
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.