latency

LLM Inference Metrics: TTFT, ITL, TPS and Goodput

A 2026 worksheet for comparing LLM inference benchmarks: define TTFT, ITL, per-user and aggregate TPS, normalize workload and timing boundaries, and reject unsupported goodput claims.