What is speculative decoding and does it save us money?

Server-side inference optimization: a fast draft model proposes tokens, the target model verifies in parallel. Reduces latency and increases throughput without changing output. Baked into modern inference stacks (vLLM, TensorRT-LLM, most provider APIs). Affects vendor selection more than direct enterprise implementation.