Skip to content
Infra

All guides

Example — not a live product. This page shows the layout for a planned guide; the title, price and contents are placeholders.

Self-hosting open LLMs

Working title. A practical guide to running open-weight language models on hardware you control.

Example entry for layout only. The idea: take an open-weight model from download to a served endpoint on your own machines, and understand the choices you make along the way.

PricePrice TBA

Placeholder price. Not set yet.

Checkout isn't open. This button doesn't take payment.

Get launch updates instead

Planned topics

Draft outline. It may change before anything is published.

  • Choosing a model size for the hardware you have
  • Quantization trade-offs
  • Serving with an inference engine behind an API
  • Monitoring latency and throughput

Other guides in the works