← Monday, September 28, 2026ArchitectureDeep dive

S3’s request-level limits challenge the stateless-compute architecture

btrblocks.com 3 min read Editor score 7/10

The piece argues that S3’s hardware assumptions shape data-system architectures, noting that individual requests deliver less than 100 MB/s while large parallel workloads can achieve high aggregate bandwidth. Engineers building data-intensive systems should consider how object-store limits affect architecture.

What: S3-based systems pair object storage with mostly stateless compute, relying on caching, batching, and separate metadata stores to work around request limits.
How: The excerpt argues SSD-based disaggregated storage and datacenter networking could enable microsecond access, small random I/O, and in-place updates.
Why it matters: Engineers choosing storage architectures must weigh S3's durability and low capacity cost against latency and request-level overheads.

The diagram shows stateless compute using S3, caching layers, and a separate metadata store. Sketched from the article's own text.

Read on btrblocks.com → Hacker News · 85 comments

Discussion

Discussion is not switched on yet. Use Note above to keep your own thoughts on this story.

Headline, summary, brief and diagram are written by a model from the source's own text; the link, byline and numbers come from the source. Read the original before relying on a claim.