Cost — Advanced
What is the cost impact of prompt caching in practice?
For workloads with stable prefixes (RAG, agent scaffolds, few-shot prompting, long system prompts), typically 3-10x reduction in input-token cost. For agent workloads (system prompt + tool schemas repeat every step), the multiplier climbs to 5-10x. Cached-input ratio below 60% on a cache-friendly workload is a red flag.
More on Cost — Advanced
Browse the full FAQ for 164 answers, or start a free GenAI maturity assessment to see where your organisation stands.