2 docs tagged with "caching"

The full ledger of the fleet's token-economy decisions — each one's value, how it was actually implemented, and its scope of applicability: when to reach for it and when not to.

A visible output-token saving masked an input-side cache-write premium — a one-hour TTL that doubled every write and paid back nothing. Spotted only on a bigger model, through a big question.