rmoff 🏃♂️🫖🥓
@rmoff.net
Pinned
Apache Hudi 1.1 Deep Dive: Optimizing Streaming Ingestion with Apache Flink
hudi.apache.org/blog/2025/12...
hudi.apache.org/blog/2025/12...
Apache Hudi 1.1 Deep Dive: Optimizing Streaming Ingestion with Apache Flink | Apache Hudi
---
hudi.apache.org
December 26, 2025 at 4:27 PM
Apache Hudi 1.1 Deep Dive: Optimizing Streaming Ingestion with Apache Flink
hudi.apache.org/blog/2025/12...
hudi.apache.org/blog/2025/12...
Clickhouse - How the 5 major cloud data warehouses really bill you
clickhouse.com/blog/how-clo...
clickhouse.com/blog/how-clo...
How the 5 major cloud data warehouses really bill you: A unified, engineer-friendly guide
This guide explains how the five major cloud data warehouses—Snowflake, Databricks, ClickHouse Cloud, BigQuery, and Redshift—allocate, meter, and bill compute, giving engineers a clear understanding…
clickhouse.com
December 26, 2025 at 4:02 PM
Clickhouse - How the 5 major cloud data warehouses really bill you
clickhouse.com/blog/how-clo...
clickhouse.com/blog/how-clo...
Yelp - S3 server access logs at scale engineeringblog.yelp.com/2025/09/s3-s...
S3 server access logs at scale
S3 server access logs at scale Nurdan Almazbekov, Infrastructure Security Sep 26, 2025 Introduction Yelp heavily relies on Amazon S3 (Simple Storage Service) to store a wide variety of data,...
engineeringblog.yelp.com
December 25, 2025 at 4:27 PM
Yelp - S3 server access logs at scale engineeringblog.yelp.com/2025/09/s3-s...
Uber - From Batch to Streaming www.uber.com/blog/from-ba...
From Batch to Streaming: Accelerating Data Freshness in Uber’s Data Lake
At Uber, the data lake is a foundational platform powering analytics and machine learning across the company. Historically, ingestion into the lake was powered by batch jobs with freshness measured…
www.uber.com
December 24, 2025 at 4:27 PM
Uber - From Batch to Streaming www.uber.com/blog/from-ba...
Data Quality Design Patterns pipeline2insights.substack.com/p/data-quali...
Data Quality Design Patterns
Overview of WAP, AWAP, TAP, and More with Implementation Examples
pipeline2insights.substack.com
December 23, 2025 at 4:27 PM
Data Quality Design Patterns pipeline2insights.substack.com/p/data-quali...
Uber - Improving MySQL Cluster Uptime: Designing Advanced Detection, Mitigation, and Consensus with Group Replication www.uber.com/en-AU/blog/i...
Improving MySQL® Cluster Uptime: Designing Advanced Detection, Mitigation, and Consensus with Group Replication
At Uber, engineers rely on MySQL® for applications that need relational databases. MySQL is the preferred choice for use cases that require ACID transactions and relational data modeling with a SQL…
www.uber.com
December 22, 2025 at 4:27 PM
Uber - Improving MySQL Cluster Uptime: Designing Advanced Detection, Mitigation, and Consensus with Group Replication www.uber.com/en-AU/blog/i...
Transactions Aren’t Enough: The Need For End-To-End Thinking blog.allegro.tech/2025/12/tran...
Transactions Aren’t Enough: The Need For End-To-End Thinking
Even the strongest safety properties implemented in today’s top databases are not enough to prevent data loss or corruption in all scenarios. We have learned to rely on mechanisms such as…
blog.allegro.tech
December 19, 2025 at 4:27 PM
Transactions Aren’t Enough: The Need For End-To-End Thinking blog.allegro.tech/2025/12/tran...
I'm forever recommending @raycast.com to folk, so I took the time to write down quite _why_ it's probably the best thing since sliced bread.
💌 A love letter to Raycast: rmoff.net/2025/12/18/a...
💌 A love letter to Raycast: rmoff.net/2025/12/18/a...
December 19, 2025 at 12:11 PM
I'm forever recommending @raycast.com to folk, so I took the time to write down quite _why_ it's probably the best thing since sliced bread.
💌 A love letter to Raycast: rmoff.net/2025/12/18/a...
💌 A love letter to Raycast: rmoff.net/2025/12/18/a...
Reposted by rmoff 🏃♂️🫖🥓
Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin...
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
December 18, 2025 at 11:36 AM
Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin...
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
Fresha - Connecting Flink, Airflow and StarRocks
Part 1: medium.com/fresha-data-...
Part 2: medium.com/fresha-data-...
Part 1: medium.com/fresha-data-...
Part 2: medium.com/fresha-data-...
December 18, 2025 at 4:27 PM
Fresha - Connecting Flink, Airflow and StarRocks
Part 1: medium.com/fresha-data-...
Part 2: medium.com/fresha-data-...
Part 1: medium.com/fresha-data-...
Part 2: medium.com/fresha-data-...
Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin...
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
December 18, 2025 at 11:36 AM
Hey check it out - I've now got a Substack! It's just the same content as on my blog, but if you prefer getting an email then feel free to subscribe. interestinglinks.substack.com/p/interestin...
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
(I've moved the publication domain, just in case you happen to have bookmarked the previous one…)
How Fresha reduced their Postgres on RDS storage footprint by 75% medium.com/fresha-data-...
December 17, 2025 at 4:27 PM
How Fresha reduced their Postgres on RDS storage footprint by 75% medium.com/fresha-data-...
🎄Interesting Links in the data world for December 2025 is here!
There's some awesomely excellent content that you'll not want to miss. Grab a mince pie and dive in :)
🔗 rmoff.net/2025/12/16/i...
There's some awesomely excellent content that you'll not want to miss. Grab a mince pie and dive in :)
🔗 rmoff.net/2025/12/16/i...
Interesting links - December 2025
rmoff.net
December 17, 2025 at 11:02 AM
🎄Interesting Links in the data world for December 2025 is here!
There's some awesomely excellent content that you'll not want to miss. Grab a mince pie and dive in :)
🔗 rmoff.net/2025/12/16/i...
There's some awesomely excellent content that you'll not want to miss. Grab a mince pie and dive in :)
🔗 rmoff.net/2025/12/16/i...
December 16, 2025 at 6:51 PM
Reposted by rmoff 🏃♂️🫖🥓
You can now query Iceberg catalogs with DuckDB – from the convenience of your browser.
In our latest blog post, we break down how DuckDB's WebAssembly client makes this possible with zero setup and showcase it in action using Amazon S3 Tables.
👉 duckdb.org/2025/12/16/i...
In our latest blog post, we break down how DuckDB's WebAssembly client makes this possible with zero setup and showcase it in action using Amazon S3 Tables.
👉 duckdb.org/2025/12/16/i...
December 16, 2025 at 3:36 PM
You can now query Iceberg catalogs with DuckDB – from the convenience of your browser.
In our latest blog post, we break down how DuckDB's WebAssembly client makes this possible with zero setup and showcase it in action using Amazon S3 Tables.
👉 duckdb.org/2025/12/16/i...
In our latest blog post, we break down how DuckDB's WebAssembly client makes this possible with zero setup and showcase it in action using Amazon S3 Tables.
👉 duckdb.org/2025/12/16/i...
Riskified's Journey to a Single Source of Truth medium.com/riskified-te...
Building Data You Can Trust: Our Journey to a Single Source of Truth
Written by Shlomit Goldenberg and Lihi Gilboa (Aziz)
medium.com
December 16, 2025 at 4:27 PM
Riskified's Journey to a Single Source of Truth medium.com/riskified-te...
Anyone know of a working equivalent of freedium.cfd? It was a great way to de-crappify Medium, but went offline a couple of months ago :(
freedium.cfd
December 16, 2025 at 2:07 PM
Anyone know of a working equivalent of freedium.cfd? It was a great way to de-crappify Medium, but went offline a couple of months ago :(
From BI to AI: A Modern Lakehouse Stack with Lance and Iceberg
lancedb.com/blog/from-bi...
lancedb.com/blog/from-bi...
From BI to AI: A Modern Lakehouse Stack with Lance and Iceberg
A comparison of where Iceberg and Lance sit in the modern lakehouse stack. We highlight emerging architectures that are bridging the worlds of analytics and …
lancedb.com
December 15, 2025 at 4:27 PM
From BI to AI: A Modern Lakehouse Stack with Lance and Iceberg
lancedb.com/blog/from-bi...
lancedb.com/blog/from-bi...
On "AI Brendans" or "Virtual Brendans": www.brendangregg.com/blog//2025-1...
December 12, 2025 at 4:27 PM
On "AI Brendans" or "Virtual Brendans": www.brendangregg.com/blog//2025-1...
How AI Agents are changing the job of a Data Engineer ai.gopubby.com/what-it-mean...
December 12, 2025 at 11:56 AM
How AI Agents are changing the job of a Data Engineer ai.gopubby.com/what-it-mean...
Deep-dive into indexes in Apache Hudi:
pt1: hudi.apache.org/blog/2025/10...
pt2: hudi.apache.org/blog/2025/11...
pt1: hudi.apache.org/blog/2025/10...
pt2: hudi.apache.org/blog/2025/11...
Deep Dive Into Hudi's Indexing Subsystem (Part 2 of 2) | Apache Hudi
In part 1, we explored how Hudi's metadata table functions as a self-managed, multimodal indexing subsystem. We covered its internal architecture—a partitioned Hudi Merge-on-Read (MOR) table using…
hudi.apache.org
December 11, 2025 at 4:27 PM
Deep-dive into indexes in Apache Hudi:
pt1: hudi.apache.org/blog/2025/10...
pt2: hudi.apache.org/blog/2025/11...
pt1: hudi.apache.org/blog/2025/10...
pt2: hudi.apache.org/blog/2025/11...
This is an excellent practical explainer from Stefan Kecskes about Kafka Connect and its components skey.uk/post/kafka-c...
December 10, 2025 at 4:27 PM
This is an excellent practical explainer from Stefan Kecskes about Kafka Connect and its components skey.uk/post/kafka-c...
What's the best data-related (or otherwise!) article you've read this month?
I'll be putting together my Interesting Links for December next week and looking for submissions :)
(missed November's? it's here: rmoff.net/2025/11/26/i...)
I'll be putting together my Interesting Links for December next week and looking for submissions :)
(missed November's? it's here: rmoff.net/2025/11/26/i...)
Interesting links - November 2025
rmoff.net
December 10, 2025 at 10:23 AM
What's the best data-related (or otherwise!) article you've read this month?
I'll be putting together my Interesting Links for December next week and looking for submissions :)
(missed November's? it's here: rmoff.net/2025/11/26/i...)
I'll be putting together my Interesting Links for December next week and looking for submissions :)
(missed November's? it's here: rmoff.net/2025/11/26/i...)
This is pretty cool - Kafka Connect and Debezium at the heart of Datadog's data replication platform www.datadoghq.com/blog/enginee...
Replication redefined: How we built a low-latency, multi-tenant data replication platform | Datadog
Discover how Datadog engineered a scalable Change Data Capture (CDC) platform to replicate data across systems in near real time—reducing search latency by 87%, increasing availability, and powering…
www.datadoghq.com
December 9, 2025 at 4:27 PM
This is pretty cool - Kafka Connect and Debezium at the heart of Datadog's data replication platform www.datadoghq.com/blog/enginee...
Real-Time Anomaly Detection with Apache Flink - @seanfalconer.bsky.social
seanfalconer.medium.com/real-time-an...
seanfalconer.medium.com/real-time-an...
Real-Time Anomaly Detection with Apache Flink
Catch critical issues before they impact revenue — learn how to detect real-time payment failures using Apache Flink and Confluent Cloud.
seanfalconer.medium.com
December 8, 2025 at 4:27 PM
Real-Time Anomaly Detection with Apache Flink - @seanfalconer.bsky.social
seanfalconer.medium.com/real-time-an...
seanfalconer.medium.com/real-time-an...