Skip to content
Spark.
All terms

Models and requests

Prefix cache

A prefix cache stores reusable computation for an identical or compatible beginning of a request. Whether it is available, matched, or billed separately is product-dependent.

Example

Repeated requests that share a long repository instruction block may reuse cached prefix work.