gpu memory

2 articles

vLLM KV Cache Capacity Planning: Context and Concurrency

A 2026 engineering guide to vLLM KV cache capacity planning: calculate architecture-derived bytes per token, reconcile startup allocation, and canary context, concurrency, FP8 and preemption controls.

10/5/2026• 25 min read

vllm kv cache capacity planningvllm kv cache memory calculationvllm concurrency

LLM Training Memory Calculator for ZeRO and FSDP

A 2026 planning model for per-rank LLM training memory, ZeRO and FSDP sharding, GPU count, CPU or NVMe offload, topology rounding, and measured validation.

9/19/2026• 21 min read

llm training memory calculatorzero memory calculatorfsdp memory calculator