All posts
A cold cache costs more than no cache at all
Writing a cache entry costs 1.27x. If the read never lands you have paid a premium for nothing, which is exactly what happens on a quiet chatbot.
Draft
Back to all posts
The full post is being written. The summary above is the argument in short.