1 article
How to design an LLM load test: open vs closed loop, Poisson and gamma arrivals, Little's law, coordinated omission, goodput, vllm bench, GuideLLM, AIPerf.