Otávio Carvalho
@otavioccc.bsky.social
Yet another software bricklayer.
Reposted by Otávio Carvalho
It's true. Every company eventually becomes a database company.
August 5, 2025 at 9:24 PM
It's true. Every company eventually becomes a database company.
Reposted by Otávio Carvalho
Intro to @apachedatafusion.bsky.social : Technology, Community and Not Quite Enough Time: www.youtube.com/watch?v=3per...
June 15, 2025 at 9:31 AM
Intro to @apachedatafusion.bsky.social : Technology, Community and Not Quite Enough Time: www.youtube.com/watch?v=3per...
Reposted by Otávio Carvalho
Last month I worked on Apache Iceberg integration for Vortex, the results of which we presented earlier this month at Iceberg Summit.
I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark
spiraldb.com/post/vortex-...
I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark
spiraldb.com/post/vortex-...
Vortex on Ice
Using Vortex to accelerate Apache Iceberg queries up to 4x
spiraldb.com
April 30, 2025 at 2:51 PM
Last month I worked on Apache Iceberg integration for Vortex, the results of which we presented earlier this month at Iceberg Summit.
I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark
spiraldb.com/post/vortex-...
I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark
spiraldb.com/post/vortex-...
Reposted by Otávio Carvalho
The recording of my keynote at Data Council 2025 is now available.
If you missed my best talk so far, you can now catch up.
The Deconstructed Database and the Advent of the Open Data Lake
www.youtube.com/watch?v=Cqhk...
If you missed my best talk so far, you can now catch up.
The Deconstructed Database and the Advent of the Open Data Lake
www.youtube.com/watch?v=Cqhk...
The Deconstructed Database and the Advent of the Open Data Lake
YouTube video by Data Council
www.youtube.com
June 3, 2025 at 11:26 PM
The recording of my keynote at Data Council 2025 is now available.
If you missed my best talk so far, you can now catch up.
The Deconstructed Database and the Advent of the Open Data Lake
www.youtube.com/watch?v=Cqhk...
If you missed my best talk so far, you can now catch up.
The Deconstructed Database and the Advent of the Open Data Lake
www.youtube.com/watch?v=Cqhk...
Reposted by Otávio Carvalho
June 8, 2025 at 4:43 AM
Reposted by Otávio Carvalho
June 7, 2025 at 3:54 PM
Reposted by Otávio Carvalho
This post from @stephanewen.bsky.social is *really* thought provoking. Their architecture seems to unify both database and stream processing architecture into one thing.
I'm not totally sure what the implications of this are yet, but it seems important.
I'm not totally sure what the implications of this are yet, but it seems important.
The Anatomy of a Durable Execution Stack from First Principles
The architecture of Restate, a Durable Execution engine built from the ground up.
restate.dev
February 27, 2025 at 5:31 PM
This post from @stephanewen.bsky.social is *really* thought provoking. Their architecture seems to unify both database and stream processing architecture into one thing.
I'm not totally sure what the implications of this are yet, but it seems important.
I'm not totally sure what the implications of this are yet, but it seems important.
Reposted by Otávio Carvalho
Is this where we currently are?
March 13, 2025 at 2:40 PM
Is this where we currently are?
Reposted by Otávio Carvalho
It's widely known that sharing a queue across multiple servers, rather than queue-per-server, often helps reduce latency and improve utilization. But when is one queue better? In my new blog post, I look at one case: different classes of work. Read it here: brooker.co.za/blog/2025/03...
March 26, 2025 at 4:34 PM
It's widely known that sharing a queue across multiple servers, rather than queue-per-server, often helps reduce latency and improve utilization. But when is one queue better? In my new blog post, I look at one case: different classes of work. Read it here: brooker.co.za/blog/2025/03...
Reposted by Otávio Carvalho
The interesting part to me is not how they answer questions. The interesting part is that maybe they will end up proving we are not very complex machines ourselves.
Have you thought about it? Maybe we are just probabilistic dummy generation machines too.
en.m.wikipedia.org/wiki/The_Lib...
Have you thought about it? Maybe we are just probabilistic dummy generation machines too.
en.m.wikipedia.org/wiki/The_Lib...
The Library of Babel - Wikipedia
en.m.wikipedia.org
March 25, 2025 at 9:43 AM
The interesting part to me is not how they answer questions. The interesting part is that maybe they will end up proving we are not very complex machines ourselves.
Have you thought about it? Maybe we are just probabilistic dummy generation machines too.
en.m.wikipedia.org/wiki/The_Lib...
Have you thought about it? Maybe we are just probabilistic dummy generation machines too.
en.m.wikipedia.org/wiki/The_Lib...
I was trying to reach out to blog.acolyer.org and realized Adrian retired and it is now offline. Although I am happy for him (and he totally deserves to pass the torch on), what a great piece of content we just lost...
blog.acolyblog.acolyer.org
February 2, 2025 at 8:01 PM
I was trying to reach out to blog.acolyer.org and realized Adrian retired and it is now offline. Although I am happy for him (and he totally deserves to pass the torch on), what a great piece of content we just lost...
Reposted by Otávio Carvalho
I was recently on a panel on "What are important data systems problems, ignored by research?" with @andypavlo.bsky.social and Allison Lee moderated by Viktor Leis - here is the write-up of the discussion databasearchitects.blogspot.com/2024/12/what...
What are important data systems problems, ignored by research?
A blog by and for database architects.
databasearchitects.blogspot.com
December 13, 2024 at 7:58 AM
I was recently on a panel on "What are important data systems problems, ignored by research?" with @andypavlo.bsky.social and Allison Lee moderated by Viktor Leis - here is the write-up of the discussion databasearchitects.blogspot.com/2024/12/what...
Serious question: Are we moving towards a Tuple Spaces revival in Distributed Systems practice?
I see everyone building on top of S3/Object Storage and nobody discussing about it at research level (or mentioning any potential links between both topics).
inria.hal.science/hal-01631715...
I see everyone building on top of S3/Object Storage and nobody discussing about it at research level (or mentioning any potential links between both topics).
inria.hal.science/hal-01631715...
inria.hal.science
December 10, 2024 at 11:47 AM
Serious question: Are we moving towards a Tuple Spaces revival in Distributed Systems practice?
I see everyone building on top of S3/Object Storage and nobody discussing about it at research level (or mentioning any potential links between both topics).
inria.hal.science/hal-01631715...
I see everyone building on top of S3/Object Storage and nobody discussing about it at research level (or mentioning any potential links between both topics).
inria.hal.science/hal-01631715...
Reposted by Otávio Carvalho
Great talk from Justin Cormack - Object Storage Is All You Need.
It’s widespread at Grafana Labs - Mimir, Loki, Tempo and Pyroscope all follow the pattern.
youtu.be/ei0wwTy6_G4
It’s widespread at Grafana Labs - Mimir, Loki, Tempo and Pyroscope all follow the pattern.
youtu.be/ei0wwTy6_G4
Object Storage Is All You Need - Justin Cormack, Docker
YouTube video by CNCF [Cloud Native Computing Foundation]
youtu.be
November 17, 2024 at 6:30 PM
Great talk from Justin Cormack - Object Storage Is All You Need.
It’s widespread at Grafana Labs - Mimir, Loki, Tempo and Pyroscope all follow the pattern.
youtu.be/ei0wwTy6_G4
It’s widespread at Grafana Labs - Mimir, Loki, Tempo and Pyroscope all follow the pattern.
youtu.be/ei0wwTy6_G4
While the Lakehouse hype and overall Stream Processing adoption are great to watch (after all those years doing and discussing about it), I'm increasingly concerned about engineering collaboration models and potential overuse.
Anyone else? What are you seeing in your organizations?
Anyone else? What are you seeing in your organizations?
November 27, 2024 at 7:23 PM
While the Lakehouse hype and overall Stream Processing adoption are great to watch (after all those years doing and discussing about it), I'm increasingly concerned about engineering collaboration models and potential overuse.
Anyone else? What are you seeing in your organizations?
Anyone else? What are you seeing in your organizations?
Reposted by Otávio Carvalho
My #SRECon talk is now out! Watch me destroy some earbuds on stage and learn how software engineering compares to other branches of engineering
www.youtube.com/watch?v=xNeS...
www.youtube.com/watch?v=xNeS...
SREcon24 Europe/Middle East/Africa - Are We Really Engineers?
YouTube video by USENIX
www.youtube.com
November 27, 2024 at 5:41 PM
My #SRECon talk is now out! Watch me destroy some earbuds on stage and learn how software engineering compares to other branches of engineering
www.youtube.com/watch?v=xNeS...
www.youtube.com/watch?v=xNeS...
Reposted by Otávio Carvalho
A short analysis of what might have contributed to the recent rise of BlueSky. Now, on the Blogs section at Communications of the ACM cacm.acm.org/blogcacm/the...
The Rise of Bluesky – Communications of the ACM
cacm.acm.org
November 27, 2024 at 6:42 PM
A short analysis of what might have contributed to the recent rise of BlueSky. Now, on the Blogs section at Communications of the ACM cacm.acm.org/blogcacm/the...
Reposted by Otávio Carvalho
Do you want to learn how @restatedev.bsky.social works under the hood and how its distributed architecture is designed? Then this video is for you 🫵 It also includes a first demo of how it runs distributed and can cope with node failures 💪
🎥 www.youtube.com/watch?v=Lgu3...
🎥 www.youtube.com/watch?v=Lgu3...
Restate: Going Distributed - Community Meeting November 2024
YouTube video by Restate
www.youtube.com
November 21, 2024 at 2:46 PM
Do you want to learn how @restatedev.bsky.social works under the hood and how its distributed architecture is designed? Then this video is for you 🫵 It also includes a first demo of how it runs distributed and can cope with node failures 💪
🎥 www.youtube.com/watch?v=Lgu3...
🎥 www.youtube.com/watch?v=Lgu3...
Reposted by Otávio Carvalho
wrote up a reply to @dustyweb.bsky.social's "How decentralized is Bluesky really" blog post
Reply on Bluesky and Decentralization | bryan newbold
This is a reply to Christine Lemmer-Webber's thoughtful (and widely read) "How decentralized is Bluesky really?" blog post.
I am so happy and grateful that Christine took the time to write up her tho...
whtwnd.com
November 27, 2024 at 12:28 AM
wrote up a reply to @dustyweb.bsky.social's "How decentralized is Bluesky really" blog post
Reposted by Otávio Carvalho
The story of how SlateDB came to be. Couldn’t have happened without reponsive.dev. And now they’re launching RS3, a streaming storage backend, built on SlateDB. 🤩
It's said that Silicon Valley is special because the density of smart and motivated people leads to chance encounters that don't happen elsewhere.
I can attest to that.
Here's how a coffee resulted in @responsive.dev building a database optimized for stream processing in 8 months. (1/n)
I can attest to that.
Here's how a coffee resulted in @responsive.dev building a database optimized for stream processing in 8 months. (1/n)
November 26, 2024 at 5:46 PM
The story of how SlateDB came to be. Couldn’t have happened without reponsive.dev. And now they’re launching RS3, a streaming storage backend, built on SlateDB. 🤩
Reposted by Otávio Carvalho
I’m fortunate to have a call with the Bluesky backend team for an hour a week, and I’m continually blown away at how good they are at engineering their systems, how thoughtful they are about protocol design, and how smoothly they’ve been handling a huge influx of new users. Seriously impressive
November 13, 2024 at 10:23 PM
I’m fortunate to have a call with the Bluesky backend team for an hour a week, and I’m continually blown away at how good they are at engineering their systems, how thoughtful they are about protocol design, and how smoothly they’ve been handling a huge influx of new users. Seriously impressive
Reposted by Otávio Carvalho
New blog post on caching in DataFusion! See how my research is advancing DataFusion’s capabilities and what’s next:
blog.haoxp.xyz/posts/cachin...
blog.haoxp.xyz/posts/cachin...
October 28, 2024 at 4:07 AM
New blog post on caching in DataFusion! See how my research is advancing DataFusion’s capabilities and what’s next:
blog.haoxp.xyz/posts/cachin...
blog.haoxp.xyz/posts/cachin...
Reposted by Otávio Carvalho
I wrote a short tutorial on using Porcupine to check for linearizability (without needing to deal with the JVM).
notes.eatonphil.com/2024-10-31-c...
notes.eatonphil.com/2024-10-31-c...
November 1, 2024 at 12:20 AM
I wrote a short tutorial on using Porcupine to check for linearizability (without needing to deal with the JVM).
notes.eatonphil.com/2024-10-31-c...
notes.eatonphil.com/2024-10-31-c...
Hello, nerds! It didn't happen, and then it happened all at once!
What a great lesson about vitality and community behavior (at least from the perspective of my little bubble)...
👋
What a great lesson about vitality and community behavior (at least from the perspective of my little bubble)...
👋
October 31, 2024 at 6:13 PM
Hello, nerds! It didn't happen, and then it happened all at once!
What a great lesson about vitality and community behavior (at least from the perspective of my little bubble)...
👋
What a great lesson about vitality and community behavior (at least from the perspective of my little bubble)...
👋
Reposted by Otávio Carvalho
Monday’s Oxide and Friends was our 4th installment of book recommendations from me, @bcantrill.bsky.social and the Oxide Friends. A big thank you to everyone who joined us live, and particularly to those who shared recommendations. youtu.be/FDPaPU5aRd0
Oxide and Friends 10/28/2024 -- Books in the Box IV
YouTube video by Oxide Computer Company
youtu.be
October 30, 2024 at 10:13 PM
Monday’s Oxide and Friends was our 4th installment of book recommendations from me, @bcantrill.bsky.social and the Oxide Friends. A big thank you to everyone who joined us live, and particularly to those who shared recommendations. youtu.be/FDPaPU5aRd0