llm inference cost

2 articles

CPU vs GPU LLM Inference: Low-Concurrency Cost Calculator

A 2026 guide to private CPU vs GPU LLM inference costs: matched-model tests, p95 latency objectives, whole-server energy, and a trace-driven calculator for reuse, purchases and fleet growth.

10/8/2026• 26 min read

cpu vs gpu llm inferencellm inference costcpu inference

Kimi K2 Hardware Requirements: VRAM, Nodes and Cost to Run

A 2026 guide to Kimi K2 hardware requirements covering VRAM and GPU needs, quantization tiers from 245GB to 1.09TB, Moonshot's 16-GPU node configuration, and self-hosting versus API cost.

7/22/2026• 41 min read

kimi k2kimi k2 hardware requirementskimi k2 vram