Unfortunately, you need to care about token caching

How about a little riddle?

You’re using your favorite AI agent. The agent responds to you. If you respond right now, your next request will cost a fraction of a cent. If you go and make a coffee before responding, the same request will cost about a cent, roughly 16 times as much. How could that be?


This is a companion discussion topic for the original entry at https://opensource.posit.co/blog/2026-10-23_ai-newsletter/