A NEW COMPUTER FOR ALWAYS-ON INTELLIGENCE
Babylon develops computer architectures for efficient AI inference at low concurrency. We start with recurrent and hybrid language models, keeping their working state next to compute to cut energy and latency.
They pay off when thousands of requests share them. With one or a few active users, much of the energy goes into moving data rather than computing.
Our approach: design a model's compression, working memory and execution as one system, starting with recurrent and hybrid models whose working state can live next to compute. The target is 10× lower energy per token at matched quality and latency.
Hardwired chips specialize one base model into silicon. Babylon is building a programmable architecture for a model family, so it carries over to the next release.
Model architectures are moving faster than the hardware beneath them. Babylon is built for where they are going.
Fixed-size, per-step-updated working memory (Gated DeltaNet, Mamba-style and test-time-training layers) are becoming a large share of inference.
Qwen3.5 ships with Gated DeltaNet layers in production.
With one or a few active users, moving and updating recurrent state can become a significant share of inference cost.
Gupta et al., March 2026, find subquadratic decode more memory-bound than standard attention at batch 1, and propose holding Gated DeltaNet state on-chip.
Dedicated state storage and execution, targeting 10× lower energy per token at matched quality and latency.
Taking that proposal from synthesis estimates to measured hardware: one Qwen3.5-4B layer on an FPGA against a strong GPU implementation.
The first two shifts are already here. The third is what we're building.
Our first milestone takes published architecture work from synthesis estimates to measured hardware: one layer of a production model on an FPGA, recurrent state on-chip, against a strong GPU implementation with the same measurement boundaries.
Measured whole-board energy and latency for on-chip state, not estimates.
State precision, memory organization and a runtime that carry one layer to a full hybrid model.
Others shape the socket for datacenter scale or for a single base model. Babylon shapes it for a model family, at the size of one device.
General-purpose and most efficient at large batch.
On-chip SRAM at datacenter scale, now mapping hybrid and linear-attention models.
A base model specialized into silicon, with light adaptation such as LoRA.
One programmable architecture for recurrent and hybrid models: reloadable weights, configurable layer dimensions, a defined operator set.
Each tier rests on the one below it, and each one ends in a measured result.
Models that write to their working memory while they run, on hardware built for it.
A state-update cell taped out on a Tiny Tapeout shuttle and characterized on the bench, running the core operation.
Recurrent layers on FPGA with attention on GPU, or the complete hybrid on a larger board, counting every device, the host and their links. One audited number per token and per watt.
DeltaNet state update for one layer of Qwen3.5-4B on an FPGA, state in on-chip memory, measured against a GPU at batch 1.
A correct reference implementation, a full memory budget and strong GPU baselines for Qwen3.5-4B, so every later result has a fair comparison.
A shared datacenter can pool demand across users. Some products can't: they need the model local, dedicated, responsive and inside a fixed power budget.
Machines, vehicles and instruments that need a capable language model on the device, within a fixed power, memory and latency budget.
Always-available assistants and agents where price, cooling and responsiveness decide the product, and idle power matters as much as peak.
Tell us the model, the task, the latency you need and the hardware you use today. Real workloads shape what we build next.
Every number we publish states its scope, from a single kernel to a full system, so it is never read as more than it is.
We optimize energy per token at matched quality and latency: the number that decides cost, cooling and battery life for AI that runs close to its user.
Reloadable weights, configurable dimensions and a defined operator set, so the architecture follows the next release instead of being rebuilt for it.
FPGAs let us measure each idea on real hardware before committing to tape-out, so every step toward silicon is backed by data on production models.
Babylon is an early-stage computer architecture company building efficient inference for recurrent and hybrid AI models. We come from systems software: model representation, compilers, runtimes and benchmarking, the layer where architecture meets the model. Now we are building out the hardware team.