Databases

2 databases stories from the Oct 21 edition.

PulseOne beat per story, in page order. Taller beats scored higher.

Databases

2 stories

Deep dive

One Hash Bloom Filters explains a compact probabilistic data structure

Bloom filters can avoid expensive database lookups; the excerpt says Bluesky uses them to save millions of Scylla queries per second. The production context makes the data-structure trade-offs relevant to engineers building high-throughput systems.

  • WhatA Bloom filter is a compact probabilistic structure that answers whether a key is definitely absent or probably present in a set.
  • HowIt hashes keys to bit-array locations; double hashing derives multiple locations from two hashes while preserving an effectively similar false-positive rate.
  • Why it mattersSystems engineers can use filters to avoid many slow database lookups, reducing I/O and helping high-throughput services scale.

Original · calabro.io 6 min read HN 149 pts · 14 comments

Notes & discussion
hash set or check … key k hash functions array of bits
Keys are hashed to bit-array locations when added to or checked against a Bloom filter. Sketched from the article's own text.

Sources today: AWS Architecture, AWS Machine Learning, ByteByteGo, Chips and Cheese, Cloudflare Blog, Google DeepMind, DuckDB, Figma Engineering, Google Cloud, GitHub Engineering, Go Blog, Google Research, Hamel Husain, Hugging Face, Import AI, InfoQ, Interconnects, Kubernetes, Latent Space, Will Larson, Lobsters (AI, distributed, performance), LWN.net, Martin Fowler, Engineering at Meta, Microsoft Research, Netflix TechBlog, NVIDIA Technical Blog, The Old New Thing, OpenAI, Pinterest Engineering, PlanetScale, The Pragmatic Engineer, PyTorch, Rust Blog, Shopify Engineering, Simon Willison, Stripe Engineering, Trail of Bits, WebKit, GitHub (new repositories), Hugging Face trending models, Hugging Face Daily Papers, Hacker News, Hacker News (AI and systems search), Lobsters, LangGraph releases, OpenAI Agents SDK releases, Transformers releases, vLLM releases. Headlines, summaries and diagrams are written by gpt-6-luna from each source's own text; links and images come from the sources themselves. Follow the link before relying on a claim.

Databases RSS · RSS · JSON · Markdown · Pulse · Search · Previous days

Your note

Private to you. Stored in this browser, and synced to your account when you are signed in.