GPUSmith
Articles (English) - Page 1 / 6
CUDA to ROCm Porting: HIPIFY Coverage and Manual Rework
A 2026 guide to CUDA to ROCm porting with HIPIFY evidence, a repository CSV inventory, library substitutions, framework constraints, correctness tests, and procurement acceptance criteria.
KV Cache Memory Calculator: Context, Concurrency and GPUs
A 2026 guide to architecture-aware KV cache sizing: calculate bytes per token, replay prompt/output distributions, reconcile vLLM and TensorRT-LLM capacity, and validate replica count against latency targets.
NCCL Algorithms and Protocols: Selection and Debugging
A 2026 guide to NCCL algorithms and protocols, covering Ring, Tree, LL, LL128 and NVLS, versioned controls, tuning logs, bandwidth formulas and reversible diagnostic experiments.
GPU ECC Error Troubleshooting: Xid, Reset, Drain or RMA
A 2026 GPU ECC troubleshooting guide for fleet operators: preserve Xid and memory evidence, decide when to drain or reset, validate with DCGM, and assemble a generation-aware OEM escalation package.
AI Data Center Demand Response and Interconnection Plan
A 2026 acceptance plan for AI data center demand response: workload SLOs, metered curtailment, recovery tests, and the evidence required before signing a flexible interconnection agreement.
InfiniBand Fabric Health: Counters and Fault Isolation
A 2026 guide to InfiniBand fabric health: read-only topology discovery, port counter interpretation, GPU-cluster fault isolation, evidence-preserving resets and an incident worksheet.
Batch vs Real-Time LLM Inference: GPU Fleet Sizing Guide
A 2026 guide to batch vs real-time LLM inference: size private GPU fleets to deadlines, benchmark SLO-qualified throughput, and compare spare-capacity reuse, reserved pools and nightly windows.
Cisco Secure AI Factory with Supermicro: October 2026 Buying Gate
An October 2026 procurement gate for Cisco Secure AI Factory with Supermicro, covering documented configurations, ordering timing, power and cooling, fabric validation, quote normalization, and acceptance evidence.
NVFP4 vs MXFP4 vs FP8 Inference Compatibility Guide
A 2026 compatibility guide to NVFP4, MXFP4, and FP8 across vLLM, SGLang, TensorRT-LLM, NVIDIA and AMD GPUs, with native versus emulated paths, artifact checks, and a reproducible validation protocol.
CPU vs GPU LLM Inference: Low-Concurrency Cost Calculator
A 2026 guide to private CPU vs GPU LLM inference costs: matched-model tests, p95 latency objectives, whole-server energy, and a trace-driven calculator for reuse, purchases and fleet growth.
vLLM KV Cache Capacity Planning: Context and Concurrency
A 2026 engineering guide to vLLM KV cache capacity planning: calculate architecture-derived bytes per token, reconcile startup allocation, and canary context, concurrency, FP8 and preemption controls.
GPU Power Cap Optimization for Inference: Cost and SLOs
A 2026 protocol for choosing inference GPU power caps using same-run energy, latency-qualified throughput, replica rounding and monthly cost scenarios, with NVIDIA, NERSC and Dell evidence.
VMware Private AI Cloud in VCF 9.1.1: Now vs Next
A 2026 implementation guide to VCF 9.1.1 Private AI Cloud: what is generally available, which AI Gateway and sandbox features are future releases, and the hardware, license and pilot evidence buyers should request.
MIG vs MPS vs Time-Slicing for Kubernetes GPU Sharing
A 2026 decision guide for Kubernetes GPU sharing: compare isolation, memory behavior and scheduler resources, then use a workload worksheet, canary scorecard and rollback plan.
BlueField-4 DPU Qualification for Private AI Systems
A 2026 engineering guide to BlueField-4 DPU qualification for private AI, covering scale-in roles, STX differences, DOCA support, measured acceptance tests, and procurement evidence.
LLM Inference Metrics: TTFT, ITL, TPS and Goodput
A 2026 worksheet for comparing LLM inference benchmarks: define TTFT, ITL, per-user and aggregate TPS, normalize workload and timing boundaries, and reject unsupported goodput claims.
DCGM Exporter GPU Monitoring: Metrics, Alerts, Triage
A 2026 operator guide to DCGM exporter GPU monitoring: field types, alert routing, MIG labels, PromQL templates, cardinality controls, and an incident triage checklist.
MIG vs MPS vs Time-Slicing: GPU Cost and Isolation
A 2026 engineering comparison of exclusive GPUs, MIG, MPS and time-slicing for inference, with isolation guarantees, model-fit profiles, SLO tests and cost per qualified tenant.
NVIDIA AI Enterprise 8.2 vs 7.8 LTSB: Upgrade Decision
A 2026 production decision guide comparing R595 and R580 drivers, version-pinned support boundaries, planned April 2027 and July 2028 end-of-life dates, and an upgrade evidence gate.
Confidential GPU Attestation: H100 to B300 Matrix
2026 comparison of H100, H200, B200, B300 and RTX PRO confidential GPU support, CPU TEE dependencies, attestation evidence, verifier ownership and procurement acceptance tests.
Triton 26.08 Upgrade Runbook: CUDA 13.4, Canary and Rollback Testing
A 2026 upgrade runbook for Triton Inference Server 26.08 covering CUDA 13.4.1 compatibility, container image selection, backend validation, canary testing, and rollback criteria.