GPU SmithCOMPUTE ENGINEERING

goodput

1 article

LLM Inference Metrics: TTFT, ITL, TPS and Goodput

LLM Inference Metrics: TTFT, ITL, TPS and Goodput

A 2026 worksheet for comparing LLM inference benchmarks: define TTFT, ITL, per-user and aggregate TPS, normalize workload and timing boundaries, and reject unsupported goodput claims.

9/28/2026• 24 min read
llm inference metricsttftinter-token latency