Changelog #0003

Hi there! Welcome to our second weekly changelog. Performance Improvement Average cache hit response times are now 8.9x faster due to data caching on the server. Fixes Fixed a bug related to traversing cache entries with 100+ children. We’re Hiring W...

More from this blog

On Automatic Template Induction for Response Caching

As of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...

Jan 7, 202614 min read

Changelog #0009

Happy Friday! Nothing user-facing to report in this week’s changelog, so hang tight. We continue to invest in internal tooling: evals, infra rewrite, and prepping last week’s automatic template induction POC for production. For fun, here’s a shout-ou...

Dec 13, 20251 min read

Changelog #0008

Welcome to Butter’s eighth changelog! Just like grandma on Thanksgiving morning, we’ve spent a whole lot of time cooking. Starting with: Gramma’s Recipe Book As a Thanksgiving treat, we launched cookwithbutter.com, which uses Butter’s LLM response ca...

Dec 6, 20252 min read

Changelog #0007

Hi all, this week’s changelog is quick and simple, nothing user-visible to announce. We’ve been making R&D progress towards better template-aware-caching, and infra progress rethinking the storage system to work with higher availability. We’ve also p...

Nov 22, 20251 min read

Changelog #0006

Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...

Nov 15, 20251 min read

Butter Blog

13 posts

Command Palette

New Examples

Bugfixes & Improvements

Comments

Updates

Changelog #0002

More from this blog