Daily databases stories worth an engineer's time.https://diffbrief.tatsatpandey.com/en-ushttps://calabro.io/ohbfhttps://calabro.io/ohbfBloom filters can avoid expensive database lookups; the excerpt says Bluesky uses them to save millions of Scylla queries per second. The production context makes the data-structure trade-offs relevant to engineers building high-throughput systems.Wed, 21 Oct 2026 06:38:00 GMTDatabasesdeep-divehttps://planetscale.com/blog/neki-updates-and-preparing-for-productionhttps://planetscale.com/blog/neki-updates-and-preparing-for-productionThe sharded Postgres platform added read-only replicas and Metal nodes as small as 1/8 vCPU, 1 GB RAM and 10 GB of NVMe storage. These changes give teams more options when evaluating a distributed Postgres deployment.Wed, 21 Oct 2026 06:38:00 GMTDatabasesreleasehttps://www.calabro.io/ohbfhttps://www.calabro.io/ohbfBloom filters can rule out keys without disk access, and Bluesky uses them to avoid millions of Scylla queries per second. The post explores a one-hash variant with potential lessons for latency-sensitive data systems.Tue, 20 Oct 2026 06:31:51 GMTDatabasesdeep-divehttps://cloud.google.com/blog/products/data-analytics/python-udf-logging-for-pipeline-observability-in-bigquery/https://cloud.google.com/blog/products/data-analytics/python-udf-logging-for-pipeline-observability-in-bigquery/Python UDFs can use the standard logging library to report row-level errors to Cloud Logging, allowing bad records to be isolated without halting a query. The end-to-end example shows a practical observability pattern for resilient data pipelines.Tue, 20 Oct 2026 06:31:51 GMTDatabasesguidehttps://github.com/kividbio/kividbhttps://github.com/kividbio/kividbKiviDB supports RESP2 and RESP3, shards its keyspace across threads, and uses io_uring on Linux with a Tokio fallback elsewhere. Those implementation choices are relevant to engineers evaluating in-memory data stores, though the excerpt gives no benchmark results.Tue, 20 Oct 2026 06:31:51 GMTDatabasestoolhttps://a5geo.org/blog/2026/10/14/a5-v1https://a5geo.org/blog/2026/10/14/a5-v1A5 1.0 commits to stable cell IDs and grid layout, alongside feature and performance improvements; one example aggregates 631 million fire detections. Stable geospatial identifiers matter to teams building durable analytics pipelines.Tue, 20 Oct 2026 06:31:51 GMTDatabasesreleasehttps://aaronmallen.me/writing/hanami-why-model-citizenshttps://aaronmallen.me/writing/hanami-why-model-citizensThe overview explains how Hanami organizes its database layer around relations, repositories, and structs rather than a traditional Rails-style model layer. It offers a useful framework-design comparison for engineers evaluating data-access patterns.Tue, 20 Oct 2026 06:31:51 GMTDatabasesguidehttps://www.usenix.org/system/files/osdi21-rodrigues.pdfhttps://www.usenix.org/system/files/osdi21-rodrigues.pdfCLP combines lossless, domain-specific compression with search on compressed text, reporting over 13× faster ingestion than Elasticsearch and Splunk and petabyte-scale operation. The approach offers a substantial storage and observability trade-off for large log archives.Sun, 18 Oct 2026 06:29:34 GMTDatabasespaperhttps://cloud.google.com/blog/products/data-analytics/cross-cloud-conversational-analytics-with-borderless-lakehouse/https://cloud.google.com/blog/products/data-analytics/cross-cloud-conversational-analytics-with-borderless-lakehouse/The described design uses the Apache Iceberg REST catalog to query remote datasets without copying them into a central staging warehouse, avoiding synchronization lag, storage costs and egress fees. It is a useful pattern for cross-cloud analytics and AI workloads.Sun, 18 Oct 2026 06:29:34 GMTDatabasesdeep-divehttps://planetscale.com/blog/planetscale-is-now-on-azurehttps://planetscale.com/blog/planetscale-is-now-on-azurePlanetScale is available in three Azure regions with high availability across three availability zones, backups and Query Insights; Vitess is not yet supported. Teams can now colocate these database workloads with Azure-based applications.Sun, 18 Oct 2026 06:29:34 GMTDatabasesreleasehttps://www.theregister.com/databases/2026/10/16/postgres-19-delayed-after-ai-reviewers-find-more-bugs-than-humans-can-fix/5303471https://www.theregister.com/databases/2026/10/16/postgres-19-delayed-after-ai-reviewers-find-more-bugs-than-humans-can-fix/5303471Postgres 19 is now expected around November 19, with eight to ten significant features deferred after AI review tooling surfaced more bugs than developers could fix. The delay is a useful example of how review capacity and tooling can affect a major database release.Sat, 17 Oct 2026 06:01:58 GMTDatabasesnewshttps://duckdb.org/2026/10/16/json-to-typed-columns.htmlhttps://duckdb.org/2026/10/16/json-to-typed-columns.htmlDuckDB can infer and adjust a schema from JSON stored in a VARCHAR column, then produce typed columns without exporting the data to a file. This removes an unnecessary round trip from common analytics and ingestion workflows.Sat, 17 Oct 2026 06:01:58 GMTDatabasesguidehttps://lwn.net/Articles/1100182/https://lwn.net/Articles/1100182/PostgreSQL’s beta has seen features reverted over architectural flaws and a long tail of edge-case defects, with LLM-assisted review surfacing issues faster. The resulting workload shows how stronger automated review can raise quality bars while increasing release-management costs.Fri, 16 Oct 2026 06:22:18 GMTDatabasesessayhttps://postgresweekly.com/issues/669https://postgresweekly.com/issues/669The roundup reports that raw conversation retrieval combined with extracted facts beat either alone in a LongMemEval rerun, while per-job savepoints slowed a Postgres queue as workers increased. Both findings offer practical leads for engineers building agent memory or database-backed workloads.Fri, 16 Oct 2026 06:22:18 GMTDatabasesnewshttps://duckdb.org/2026/10/13/inside-iceberg-table.htmlhttps://duckdb.org/2026/10/13/inside-iceberg-table.htmlThe guide walks through Iceberg metadata, manifest lists, manifests, data files and delete files, showing how DuckDB can inspect each layer with SQL. Understanding that structure helps diagnose slow or incorrect table queries without treating the table as a black box.Fri, 16 Oct 2026 06:22:18 GMTDatabasesdeep-divehttps://stripe.com/blog/real-time-stripe-data-postgreshttps://stripe.com/blog/real-time-stripe-data-postgresStripe Data Pipeline can now keep Postgres databases current with Stripe data, replacing custom sync integrations. The change may simplify the data plumbing behind applications that depend on current payment and account state.Fri, 16 Oct 2026 06:22:18 GMTDatabasesreleasehttps://github.com/timescale/pg_vectorsearchhttps://github.com/timescale/pg_vectorsearchThe alpha PostgreSQL extension combines hierarchical routing, RaBitQ quantization and SIMD distance calculations for approximate nearest-neighbor indexes, with dynamic updates. It could be worth evaluating for vector-search workloads, but the excerpt provides no comparative benchmark results.Thu, 15 Oct 2026 06:22:59 GMTDatabasestoolhttps://marcpaul.io/logs/same-job-two-engines-innodb-and-iceberg-internals/https://marcpaul.io/logs/same-job-two-engines-innodb-and-iceberg-internals/The comparison explains that InnoDB stores rows together, making selective reads efficient, while each B-tree index adds work to writes; it also introduces undo logs for concurrent reads and writes. These trade-offs help engineers reason about OLTP and OLAP workload choices.Thu, 15 Oct 2026 06:22:59 GMTDatabasesdeep-divehttp://peter.eisentraut.org/blog/2026/10/09/the-reverts-will-continue-until-morale-improveshttp://peter.eisentraut.org/blog/2026/10/09/the-reverts-will-continue-until-morale-improvesA PostgreSQL developer reflects on 8–10 significant features reverted after the 19 beta began, including some late in the beta period. The discussion offers lessons for database contributors and teams managing risky releases.Wed, 14 Oct 2026 06:38:54 GMTDatabasesessayhttps://planetscale.com/blog/what-gets-toasted-in-postgreshttps://planetscale.com/blog/what-gets-toasted-in-postgresThe piece shows that a 2,000-byte value remains uncompressed while a 2,001-byte value is compressed to 26 bytes, then explains row-page limits and TOAST behavior. It also covers Postgres 19's shift to LZ4, useful context for storage and compression trade-offs.Tue, 13 Oct 2026 08:14:15 GMTDatabasesdeep-divehttps://arxiv.org/pdf/cs/0701155https://arxiv.org/pdf/cs/0701155The paper defines the cube operator as a relational generalization of grouping, cross-tabs, roll-ups, and subtotals, and discusses efficient computation. Its model remains useful context for engineers working on analytical query systems.Tue, 13 Oct 2026 08:14:15 GMTDatabasespaperhttps://github.com/rogerbinns/apswhttps://github.com/rogerbinns/apswThe wrapper provides SQLite features including virtual tables, VFS, JSON and session support, with synchronous and async usage. It is a useful option when Python applications need more than the standard sqlite3 interface.Mon, 12 Oct 2026 07:53:06 GMTDatabasestoolhttps://github.com/ClickHouse/clickhouse-chttps://github.com/ClickHouse/clickhouse-cThe C client decodes ClickHouse Native Format blocks and can read `clickhouse-local` output from a pipe without TCP or compression. Its PostgreSQL-extension-oriented design may interest engineers integrating ClickHouse with other systems.Mon, 12 Oct 2026 07:53:06 GMTDatabasestoolhttps://db.cit.tum.de/~durner/papers/json-tiles-sigmod21.pdfhttps://db.cit.tum.de/~durner/papers/json-tiles-sigmod21.pdfJSON tiles detect important keys, extract them for relational queries, and collect statistics for the optimizer while supporting changing schemas. The paper reports scan performance similar to columnar storage, a useful approach for semi-structured data systems.Sun, 11 Oct 2026 07:44:51 GMTDatabasespaperhttps://projecttimestamper.org/blog/common-crawl/https://projecttimestamper.org/blog/common-crawl/Project Timestamper says it has cryptographically timestamped Common Crawl’s 339 billion web snapshots, spanning 18 years and more than 10 petabytes. Provenance for large web archives matters to engineers working with data at scale.Sun, 11 Oct 2026 07:44:51 GMTDatabasesnewshttps://github.com/duckdb/ducklakehttps://github.com/duckdb/ducklakeThe DuckDB extension reads and writes an open lakehouse format that keeps metadata in a catalog database and data in Parquet files. Its SQL-based approach is relevant to engineers evaluating lakehouse storage and query workflows.Fri, 09 Oct 2026 07:53:56 GMTDatabasestoolhttps://planetscale.com/blog/tin-v106https://planetscale.com/blog/tin-v106The update adds stemming and heap-attribute tiebreakers for top-k ordering; PlanetScale says TIN v1.0.6 is 2–3× faster and has regained the lead in its comparisons. Database engineers evaluating Postgres full-text search can assess the index’s feature and performance claims.Fri, 09 Oct 2026 07:53:56 GMTDatabasesreleasehttps://theconsensus.dev/p/2026/09/13/query-plan-rewriting-in-postgresql.htmlhttps://theconsensus.dev/p/2026/09/13/query-plan-rewriting-in-postgresql.htmlThe piece distinguishes statically knowable rewrites, such as folding `i+0`, from optimization decisions that depend on statistics and data. Understanding that boundary helps engineers reason about query plans and database performance.Fri, 09 Oct 2026 07:53:56 GMTDatabasesdeep-divehttps://duckdb.org/2026/10/07/view-only-mode.htmlhttps://duckdb.org/2026/10/07/view-only-mode.htmlDuckDB can hold only view definitions pointing to Parquet files on object storage, creating a shareable catalog that stays a few hundred kilobytes regardless of dataset size. This pattern separates query access from data copies and can simplify sharing data lake datasets.Thu, 08 Oct 2026 07:59:03 GMTDatabasesguide