Topics · Concept
Inference
Running models in production: routing, cost, hardware, and inference as a metered utility.
- Within
- AI platforms
- Includes
- GPUs
- Pages
- 5
On the map 5 pages and the topics around it
2026
- 14 min
The Model Is a Dependency
Every layer of the harness has existed to put the right tokens in front of one hardcoded model string. This post pulls that string out and makes the model a dependency: why you route a cheap model for easy turns and a strong one for hard turns, what a fallback looks like when a provider is down, and why 'models are commodities' is a claim about your architecture before it is a claim about the market. Part seven of The Agent Platform Handbook.
- 13 min
Brain Emulation, Read as an Infrastructure Problem
An MIT thesis argues brain emulation has crossed into engineering. Read as infrastructure, the numbers describe a workload your AI cluster was not built for.
- 12 min
The Economics of Inference
Inference tokens are not API calls. They are a metered resource that is consumed, generates value, and correlates with power draw. The economics of the post-AI world look less like software and more like water, electricity, and gas.
- 23 min
What Comes After the Last Programming Language
If AI generates machine code directly, why are we still running operating systems designed for humans? The answer might be an inference-native OS.
- 23 min
Archipelag.io Is in Open Beta: Here's Why I Built It
From watching Ethereum miners in 2016 to building a decentralized compute network in open beta. Architecture, conviction, and the long road.