What is prompt caching and when does it matter?

A provider optimization that reuses the KV cache for repeated prompt prefixes across requests, typically reducing input token cost by ~10×. It matters when you have large stable prefixes — RAG contexts, agent scaffolds, few-shot examples, long system prompts. Anthropic, OpenAI, and Google all offer it; use it aggressively for any workload with reusable context.