1. Home
  2. Resources
  3. AI Inference at Scale

AI Inference at Scale

This technical guide from O'Reilly discusses the economics and anatomy of production AI inference, focusing on topics such as aligning business metrics with technical reality, enterprise serving engines, distributed inference, and more. The guide provides insights into the challenges of inference efficiency and the importance of matching product work to the serving capacity it consumes.

 

Front cover of analyst paper