Skip to content

CONCEPT

Prompt caching

Prompt caching — Concept. description: Prefill reuse mechanism via prefix matching · role: Decisive pricing variable for agentic traffic, which resends the same context at every step

description
Prefill reuse mechanism via prefix matching
role
Decisive pricing variable for agentic traffic, which resends the same context at every step

Related entities

Fiches (2)