data-processing
10 projects share this GitHub topic
Lines connect members that are measurably related to each other. Dot size reflects stars.
🧬 Members
pathway
Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
★ 62.6k
data-juicer
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
★ 6.7k
DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data…
★ 5.7k
rocketride-server
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale…
★ 5.3k
DialoGPT
Large-scale pretraining for dialogue
★ 2.4k
texar
Toolkit for Machine Learning, Natural Language Processing, and Text Generation, in TensorFlow. This is part…
★ 2.4k
bytewax
Python Stream Processing
★ 2k
dolma
Data and tools for generating and inspecting OLMo pre-training data.
★ 1.5k
Machine-Learning-Notebooks
Machine Learning notebooks for refreshing concepts.
★ 553
fondant
Production-ready data processing made easy and shareable
★ 358
🔗 Related families
Measured from GitHub topics shared by both projects, weighted by how rare each topic is.