Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Agent S: an open agentic framework that uses computers like a human

Mobile-Agent: The Powerful GUI Agent Family

[NeurIPS 2025] SpatialLM: Training Large Language Models for Structured Indoor Modeling

[CVPR'25] Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 🍓

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

Official Repo For Pixel-LLM Codebase: Sa2VA (Arxiv-25), SAMTok (CVPR-26), VRT, SaSaSa2VA (1-st solution for LSVOS)

[CVPR2026] Detect Anything via Next Point Prediction

A family of lightweight multimodal models.

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

OpenEMMA, a permissively licensed open source "reproduction" of Waymo’s EMMA model.

OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s. Works with Claude Code.

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

Fully Open Framework for Democratized Multimodal Training