agent-substrate/substrate
Google's open-source system for cramming hundreds of AI agents onto just a handful of servers
Agent Substrate packs many mostly-idle AI agent processes onto a small pool of shared servers to save resources. Built on Kubernetes, it can suspend and resume an agent in under a second, letting it fake having far more workers than it actually has. In a demo, it ran 250 stateful agents on only 8 physical pods.
What it does
- It registers far more agents ('actors') than there are actual worker servers, exploiting the fact that agent-like apps are idle most of the time to multiplex them onto a small pool
- Agents run inside isolation technologies like microVMs or gVisor, letting the system suspend and resume them in under a second while preserving RAM and filesystem state via full snapshots
- It's not an SDK for writing agents but infrastructure for running already-built agents at scale, regardless of the framework (ADK, LangChain, Claude Code, MCP servers, etc.)
- It layers agent-specific scheduling on top of Kubernetes Pods and autoscaling, and its demo shows 250 stateful actors running across just 8 physical pods
- The project states it is in early development, not ready for production, and its APIs are expected to change
Why it matters
Running LLM-based agents in production usually means each one ties up server resources continuously, which drives costs up fast; this project tries to change that math by exploiting the fact that agents spend most of their time idle. Because it works at the container level rather than locking users into one agent framework, it's directly relevant to teams that need to run many different agent stacks at scale.
Terms in this repo
- gVisor · A container sandbox technology from Google that isolates execution at the kernel level
- microVM · A lightweight virtual machine that boots much faster and lighter than a full VM
- actor · An individual agent/application instance managed by the system
- worker · The physical resource unit (a Kubernetes Pod) that actually runs an actor
- oversubscription · Registering more workloads than there is physical capacity, assigning resources only as needed
Repository description (English)
Agent Substrate: the core system
Open on GitHubTrending repos
- cathrynlavery/diagram-designA skill that makes AI coding tools draw magazine-quality diagrams instead of generic rounded boxes
- public-apis/public-apisA giant crowd-curated directory of free APIs for developers
- semantica-agi/semanticaAn open-source graph infrastructure that lets AI agents show their work, not just their answers
- cactus-compute/needleA 14MB AI model small enough to run tool-calling on a phone or watch, without internet
- unslothai/unslothA desktop app that lets you run and train AI models on your own computer, no coding required
- macro-inc/macroAn all-in-one workspace where email, chat, docs, tasks, and CRM are cross-linked and share one AI memory
- harry0703/MoneyPrinterTurboAn open-source tool that turns a single topic or keyword into a finished short video, complete with script, footage, subtitles, and music
- basecamp/omarchyA ready-made, opinionated Linux setup built by DHH
Latest from METAL LAB
- Grok leaks conversations, location data via commands hidden in ciphertext
- Cursor lets agents handle long-running tasks with new "/goal" command
- NVIDIA releases Switchyard, an LLM routing proxy for coding agents
- Caveman Cuts Claude Code Token Usage by 33% Using Caveman-Speak
- Apple Keeps 2027 Target for Camera AirPods, Qwen3.8-27B Makes 80 Tool Calls Locally