Skip to content
Spark.
All terms

Models and requests

Cache tokens

Cache tokens are input tokens associated with a reusable prefix cache. Depending on the provider, usage may distinguish cache reads, cache writes, or both, with different accounting rules.

Example

A usage record can separately show cached reads and a cache write for an unchanged project brief.