Rust on Fulgurion Systems Blog

Streaming LLM Tokens Through AWS API Gateway

Thu, 30 Apr 2026 00:00:00 -0300

The previous four posts (Part 1, Part 2, Part 3, Part 4) covered Rust on Lambda from cold starts to architectural fit. This one is a sibling rather than a sequel, focused on a specific AWS gotcha that bites anyone wiring an LLM behind API Gateway: HTTP API v2 does not support response streaming. The modern, recommended Gateway flavor is the wrong tool for streaming LLM tokens. The older REST API got streaming support in November 2025. If you reach for HTTP API v2 by reflex (and most “use the modern one” guides will tell you to), your token stream silently collapses into a single buffered response.

Rust Meets Serverless, Part 4: When Lambda Is the Wrong Tool

Fri, 24 Apr 2026 00:00:00 -0300

In Part 1, Part 2, and Part 3 I argued for Rust on Lambda and measured where the gains come from. This post draws the other edge of that fence: the shapes of work where Lambda is the wrong architectural choice, however lean the binary, and whichever language you wrote it in. The common thread across every case below is a single billing fact: Lambda charges you for wall-clock duration, including the time your handler spends waiting on IO.

Rust Meets Serverless, Part 3: Anatomy of a Cold Start

Wed, 22 Apr 2026 00:00:00 -0300

In Part 2 I measured the cold start of a minimal Rust Lambda at 18 to 22 ms. This post breaks down what that init window is actually paying for, and which parts you can move.

The short version: out of the four phases that make up a cold start, only two are under your control. The rest is AWS infrastructure that you inherit whether you like it or not.

The Four Phases

Rust Meets Serverless, Part 2: Cold Start Times

Tue, 21 Apr 2026 00:00:00 -0300

In Part 1 I covered why Rust on AWS Lambda is worth exploring and laid out the project setup. This post measures the one number that matters most for serverless latency: cold start time. To get a clean floor measurement, I used the simplest possible endpoint with no database, no external calls, and no middleware.

The Benchmark Setup

The handler is a single health endpoint built with Axum and Cargo Lambda:

Rust Meets Serverless, Part 1: Getting Started with AWS Lambda

Mon, 20 Apr 2026 00:00:00 -0300

After watching Benjamen Pyle’s talk on Rust and AWS Lambda at QCon 2025, I got curious enough to try it myself. Rust is known to be one of the best languages for building high-performing services, used across different industries where performance and stability are non-negotiable. One would expect these services to run on dedicated instances (either in the cloud or on bare-metal machines) in order to take full advantage of its benefits. However, in this post I explore whether Rust can be efficiently used in AWS Lambda.