Changelog #0001

Hi everyone! Welcome to our first of many weekly changelogs, set to run every Friday. Follow along for weekly updates and improvements.

This week was primarily focused on ensuring compatibility with upstream providers (OpenAI, for the time being) and downstream agent frameworks.

Features

Brotli compression support

Added support to handle large compressed responses from OpenAI.

Transparent forwarding

All requests to unsupported endpoints, such as Responses or Encodings, are now transparently forwarded without involving the cache. This allows popular agent libraries pointed at Butter proxy to operate as expected, with caching only on the Chat Completions requests.

Request pagination

Dashboard home-page loads are now much faster for users with moderate request traffic.

Security & Uptime

• Data access controls improved on UI backend

• Uptime monitors and alerts configured

Fixes

• Various UI rendering/flickering bugs

• Stale-segfault bug in proxy

• Broken links in cache graph UI

• Mobile reactivity improved*

  • *with a message that says “use desktop please”