Changelog #0003

UpdatedOctober 24, 2025

•1 min read

Erik Dunteman

Part of seriesUpdates

Welcome to Butter’s third weekly changelog. This week we’ve been focused on content, documentation, and examples.

New Examples

Examples section added to Docs, highlighting how to repoint popular AI tools through the Butter proxy endpoint. These include:

LLM Clients & Agent Frameworks
Other HTTP proxies/gateways
- Helicone
- LiteLLM
- Martian
Specialized Tools
- Browser Use (custom fork)
- DSPy

Bugfixes & Improvements

Fixed race condition which caused thrashing in server’s disk cache
Added internal load tests, currently hitting ~120rps

Updates

Part 6 of 8

Updates from the Butter team

Up next

Hi there! Welcome to our second weekly changelog. Performance Improvement Average cache hit response times are now 8.9x faster due to data caching on the server. Fixes Fixed a bug related to traversing cache entries with 100+ children. We’re Hiring W...

More from this blog

On Automatic Template Induction for Response Caching

As of last week, Butter’s proxy now offers automatic template induction for its response cache! We’ve prepared the following blog post to help explain its significance and potential to help you serve more LLM responses from cache. You can also read t...

Jan 7, 202614 min read

Changelog #0009

Happy Friday! Nothing user-facing to report in this week’s changelog, so hang tight. We continue to invest in internal tooling: evals, infra rewrite, and prepping last week’s automatic template induction POC for production. For fun, here’s a shout-ou...

Dec 13, 20251 min read

Changelog #0008

Welcome to Butter’s eighth changelog! Just like grandma on Thanksgiving morning, we’ve spent a whole lot of time cooking. Starting with: Gramma’s Recipe Book As a Thanksgiving treat, we launched cookwithbutter.com, which uses Butter’s LLM response ca...

Dec 6, 20252 min read

Changelog #0007

Hi all, this week’s changelog is quick and simple, nothing user-visible to announce. We’ve been making R&D progress towards better template-aware-caching, and infra progress rethinking the storage system to work with higher availability. We’ve also p...

Nov 22, 20251 min read

Changelog #0006

Welcome to Butter’s latest weekly changelog. Today’s log is light, as we strengthen our focus on the R&D-side of templated caching. This week, we’ve also seen some more signups, which have brought about a higher volume of requests through Butter’s pr...

Nov 15, 20251 min read

Butter Blog

13 posts

Command Palette

New Examples

Bugfixes & Improvements

Updates

Changelog #0002

More from this blog