Definition · context memory
context caching
context caching is the term for Saving reused prompt or context material so later model calls can be faster or cheaper. You can spot context caching in practice when the record shows what the system observes, what choice it makes, and what changes next, without asking the reader to guess or trust a slogan.
157 definitions656 sourced recordsNamed source: ACL Anthology
Why does context caching matter?
A cache can cut cost and wait time. Old or private content must not leak into the next call. For context caching, start with three checks: What is kept, and for how long? Who can write or retrieve it? How would bad data be found and removed? The answers should point to visible evidence, not a promise.
What does context caching look like?
A support tool reuses one product guide but keeps account data out of the cache. This example makes context caching visible by naming the actor, the action, and the result in practice. It is an illustration for readers, not a claim that every product behaves this way.
What is context caching easy to confuse with?
Context caching reuses stored prompt content. Long-term memory keeps facts for use in later runs. The closest entries here are working memory, context compression, context engineering. Compare their definitions with context caching before using the names as if they mean the same thing. That comparison keeps context caching separate from nearby ideas without pretending the boundary is always perfect.
How certain is this definition?
This definition is provisional. ACL Anthology supports the version you see today, but a better or more direct source may change it. Open the cited page and check its date before you use this entry to choose a product, write a policy, set a safety control, or design a system.
Who introduced the term context caching?
We have not verified who first introduced context caching. The source supports a useful definition, but it may not be the earliest use. Until a dated primary record settles the question, we leave the origin open. A popular article or product page is not enough to name the person who coined a term.
What should you understand before context caching?
Read memory first when context caching depends on a more basic idea or mechanism. The link gives you a useful route through the glossary. It does not mean every author teaches the subject in this order, so follow the source when the sequence matters.
What should this term help you answer?
Use context caching to ask what an agent can observe, decide, change, remember, or hand off. The questions below turn the definition into a practical check. They are prompts for your own work, not claims made by the source, so change them to fit the system you are examining.
- What is kept, and for how long?
- Who can write or retrieve it?
- How would bad data be found and removed?
Which source supports this definition of context caching?
ACL Anthology supports this working definition of context caching. We checked the link on 2026-07-12. Open the original record for its context, methods, limits, and publication details. The short explanation here is a guide to context caching; the linked source remains the evidence to inspect when the wording or boundary matters.
source foundcontext cachingChecked 2026-07-12→