Skip to content
Infra

Run AI on hardware you can size.

Infra makes practical e-books and guides for engineers who self-host language models: picking GPUs, building inference stacks, and keeping private data private.

Will it fit on one 80 GB GPU?

Model size
Weight precision

140 GB of weights. That does not fit. Weights alone need 2 cards, or a lower precision.

Rough, weights-only arithmetic (parameters × bits ÷ 8). Real deployments need extra memory.

Guides in the works

These are example entries. Titles are working titles, prices aren't set, and none are on sale yet.

News

Notes on what's being written, and what's changing in self-hosted AI.

All news

About Infra

Most writing about AI assumes you call someone else's API. Infra is for the other case: you run the model, so you pick the hardware, the serving stack, and where the data lives.

The guides are meant to be read with a terminal open. Each one aims to answer a concrete question an engineer or tech lead hits when moving a model onto their own infrastructure, such as how much GPU memory a deployment needs or how to keep retrieval data inside your network.

Hear when the first guide ships

One email when there's something to read. Sign-ups open soon.