Every agent resends its whole context at every step, and every provider bills the repeat at a discount with a timer attached. The discount and the timer both come from one single ratio.
Why Cached Tokens Cost 10% and Vanish in 5…
Every agent resends its whole context at every step, and every provider bills the repeat at a discount with a timer attached. The discount and the timer both come from one single ratio.