1 article
How max_num_batched_tokens and chunked-prefill-size trade TTFT against ITL in vLLM and SGLang, with defaults, worked arithmetic and a sweep protocol.