WHITE PAPERS
In-depth technical papers on data platform design. Series 1 examines how modern storage engines are built and how to choose an engine class; Series 2 examines how to cache data fast without serving it wrong.
Free to read and download · No registration required
SERIES 1
Six papers, from a survey of the whole field to a deep dive on each class of engine. All six can be read online or downloaded as PDF.
PAPER 1 · PUBLISHED
A survey of five engine classes (write-optimized, analytical, hardware-native, vector and lakehouse) and the trade-offs that separate them.
PDF, 6 pages · 26 October 2026
PAPER 2 · PUBLISHED
Compaction, write amplification and tuning in RocksDB-family engines, with the open challenges and research directions.
PDF, 15 pages · 26 October 2026
PAPER 3 · PUBLISHED
How columnar layout, compression and vectorized execution use CPU caches and SIMD, with the open challenges and research directions.
PDF, 17 pages · 26 October 2026
PAPER 4 · PUBLISHED
ANN indexes, quantization, filtering and updates in vector search, with the open challenges and research directions.
PDF, 18 pages · 26 October 2026
PAPER 5 · PUBLISHED
Apache Iceberg, Delta Lake and Apache Hudi: transactions, metadata, maintenance and interoperability, with the open challenges and research directions.
PDF, 17 pages · 26 October 2026
PAPER 6 · PUBLISHED
Consensus replication, sharding, distributed transactions and PostgreSQL compatibility, with the open challenges and research directions.
PDF, 20 pages · 26 October 2026
SERIES 2
Six papers: a foundation on caching strategies, architectures, eviction and pitfalls, then five research frontiers in depth. All six can be read online or downloaded as PDF.
PAPER 1 · PUBLISHED
Read and write strategies, cache architecture types, eviction and invalidation policies, and the common pitfalls with their mitigations.
PDF, 20 pages · 26 October 2026
PAPER 2 · PUBLISHED
Machine learning for eviction and admission decisions, from approximating the optimal policy to production-ready designs.
PDF, 17 pages · 26 October 2026
PAPER 3 · PUBLISHED
Reusing answers and computation by meaning, with the correctness, access control and evaluation questions it raises.
PDF, 19 pages · 26 October 2026
PAPER 4 · PUBLISHED
Caches that span DRAM, CXL-attached memory and flash, and the placement and endurance trade-offs between tiers.
PDF, 18 pages · 26 October 2026
PAPER 5 · PUBLISHED
Tracking what cached data depends on, so that changes invalidate exactly what they should.
PDF, 17 pages · 26 October 2026
PAPER 6 · PUBLISHED
Cache hierarchies from device to edge to region to core, and the consistency and placement choices between them.
PDF, 16 pages · 26 October 2026
EDITORIAL STANDARDS
Tell us which storage or caching decision your team is facing.
A short architecture workshop maps your workloads to engine classes and caching strategies, and plans how to validate the choice.