Glossary
Prompt caching
Reusing computation for the repeated prefix of prompts — system instructions, tool schemas, standing context — so consecutive calls pay only for what changed. For agent loops sharing a large stable prefix, cost and latency can drop dramatically.
In AGNT
AGNT’s cache-efficiency research measured exactly this across agent harnesses — see The Cache Wars whitepaper.