foundation-models

43 projects share this GitHub topic

Lines connect members that are measurably related to each other. Dot size reflects stars.

🧬 Members

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Janus-Series: Unified Multimodal Understanding and Generation Models

⚡ TabPFN: Foundation Model for Tabular Data ⚡

YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open

chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence…

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

Images to inference with no labeling (use foundation models to train supervised models).

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and…

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

awesome-japanese-llm

日本語LLMまとめ - Overview of Japanese LLMs

KnowledgeEditingPapers

Must-read Papers on Knowledge Editing for Large Language Models.

Awesome-Foundation-Models

A curated list of foundation models for vision and language tasks

Foundation-Models-Framework-Lab

A practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One…

[ECCV 2024 Best Paper Candidate & TPAMI 2025] PointLLM: Empowering Large Language Models to Understand Point…

VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models

[MICCAI 2019 Young Scientist Award] [MEDIA 2020 Best Paper Award] Models Genesis, one of the first…

Foundational Model for Speech Recognition Tasks

Awesome-Reasoning-Foundation-Models

✨✨Latest Papers and Benchmarks in Reasoning with Foundation Models

PyTorch Implementation of EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervision

[ICCV 2025 & ICCV 2025 RIWM Outstanding Paper] Aether: Geometric-Aware Unified World Modeling

tokenize-anything

[ECCV 2024] Tokenize Anything via Prompting

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

HoloMotion: A Foundation Model for Whole-Body Humanoid Control

Large Language & Foundation Models for Time Series.

Heterogeneous Pre-trained Transformer (HPT) as Scalable Policy Learner.

[NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (https://arxiv.org/abs/2501.06425)

Official repo of VLABench, a large scale benchmark designed for fairly evaluating VLA, Embodied Agent, and…

[CVPR 2025 Highlight] Official code for "Olympus: A Universal Task Router for Computer Vision Tasks"

ai-powered-search

The codebase for the book "AI-Powered Search" (Manning Publications, 2025) and associated "AI-Powered Search:…

BioReason: Incentivizing Multimodal Biological Reasoning within a DNA-LLM Model | NeurIPS '25

Official code base for MinD-Video

The official repo for [TPAMI'25] "HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model"

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave,…

World Model based Autonomous Driving Platform in CARLA :car:

Production-ready data processing made easy and shareable

GRID-playground

Platform for General Robot Intelligence Development

[CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts

Awesome-Multimodal-LLM-Autonomous-Driving

[WACV 2024 Survey Paper] Multimodal Large Language Models for Autonomous Driving

Official implementation of Meta Prompting for AI Systems (https://arxiv.org/abs/2311.11482)

🔗 Related families

multimodal 70 gpt-4 71 forecasting 12 instruction-tuning 15 llama 65 embodied-ai 46 audio-generation 19 huggingface 50

Measured from GitHub topics shared by both projects, weighted by how rare each topic is.