
Disaggregating Prefill and Decode: Faster First Tokens, Faster Streams
6 links

Disaggregating Prefill and Decode: Faster First Tokens, Faster Streams

Cloudflare investigated CPU performance benchmark results for Workers, uncovering and fixing issues in infrastructure, V8 garbage collection, and OpenNext optimizations. These improvements have made Cloudflare Workers faster for all customers.

A quick guide on how to set up OPCache and fine-tune PHP-FPM.

I spent a month repeatedly building my website in Docker, and now have horrors to share.

The power of Zig's comptime code execution

Super quick one I want to document here! I got myself on a side quest,
again! No biggie, my ZSH shell was taking ages to load. When I say
ag...