Changelog #0008
Command Palette
Search for a command to run...
Comments
Join the discussionNo comments yet. Be the first to comment.
More from this blog
On Automatic Template Induction for Response Caching
As of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...
Jan 7, 202614 min read
Changelog #0009
Happy Friday! Nothing user-facing to report in this week’s changelog, so hang tight. We continue to invest in internal tooling: evals, infra rewrite, and prepping last week’s automatic template induction POC for production. For fun, here’s a shout-ou...
Dec 13, 20251 min read
Changelog #0007
Hi all, this week’s changelog is quick and simple, nothing user-visible to announce. We’ve been making R&D progress towards better template-aware-caching, and infra progress rethinking the storage system to work with higher availability. We’ve also p...
Nov 22, 20251 min read
Changelog #0006
Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...
Nov 15, 20251 min read
