Vignesh Chandramohan
@vigneshc.bsky.social
Short talk on Iceberg use cases in last week's Seattle Iceberg meetup.
youtu.be/F7qpOVVnxek?...
youtu.be/F7qpOVVnxek?...
Iceberg Use Cases at DoorDash
YouTube video by Apache Iceberg™ Meetup
youtu.be
October 31, 2025 at 2:42 AM
Short talk on Iceberg use cases in last week's Seattle Iceberg meetup.
youtu.be/F7qpOVVnxek?...
youtu.be/F7qpOVVnxek?...
Reposted by Vignesh Chandramohan
If you find yourself in SF next week, @almog.xyz is talking about SlateDB at the SF Systems Meetup on Wednesday!
SF Systems Meetup: Databases and Stateful Apps · Luma
The SF Systems Meetup is back with a pair of talks giving us a peek at the future of state management! This month, we're excited to have talks from Almog Gavra…
luma.com
October 21, 2025 at 4:45 PM
If you find yourself in SF next week, @almog.xyz is talking about SlateDB at the SF Systems Meetup on Wednesday!
1/ Nice read:
medium.com/@xiafan/time...
Software engineer growth in AI era:
* Build composable tools.
* Assume non deterministic outcomes from a group of ai agents.
* Understand how LLM works to the next level, like how you would understand to read a query plan.
medium.com/@xiafan/time...
Software engineer growth in AI era:
* Build composable tools.
* Assume non deterministic outcomes from a group of ai agents.
* Understand how LLM works to the next level, like how you would understand to read a query plan.
Time to Adapt and Become a Better Engineer
A colleague recently asked if I think AI agents could do all the jobs humans do. My answer was an unequivocal yes. Given the same sensory…
medium.com
September 27, 2025 at 8:58 PM
1/ Nice read:
medium.com/@xiafan/time...
Software engineer growth in AI era:
* Build composable tools.
* Assume non deterministic outcomes from a group of ai agents.
* Understand how LLM works to the next level, like how you would understand to read a query plan.
medium.com/@xiafan/time...
Software engineer growth in AI era:
* Build composable tools.
* Assume non deterministic outcomes from a group of ai agents.
* Understand how LLM works to the next level, like how you would understand to read a query plan.
Reposted by Vignesh Chandramohan
Just added sqlync.com to SlateDB's adopters list! They're building a streaming system that speaks MQTT or PostgreSQL across millions of connected users and devices. 🤯
SQLync
sqlync.com
August 25, 2025 at 7:05 PM
Just added sqlync.com to SlateDB's adopters list! They're building a streaming system that speaks MQTT or PostgreSQL across millions of connected users and devices. 🤯
Reposted by Vignesh Chandramohan
Insane amount of SlateDB work going on:
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
June 18, 2025 at 2:48 PM
Insane amount of SlateDB work going on:
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
- snapshot reads
- split/merge DBs (zero copy)
- deterministic simulation testing
And someone just pushed Python bindings in a PR! 🤯
My Data council talk on SlateDB.
youtu.be/gcTRXZeKbNg?...
youtu.be/gcTRXZeKbNg?...
Internals of SlateDB: An Embedded Key Value Store Built On Object Storage
YouTube video by Data Council
youtu.be
May 30, 2025 at 5:33 AM
My Data council talk on SlateDB.
youtu.be/gcTRXZeKbNg?...
youtu.be/gcTRXZeKbNg?...
Reposted by Vignesh Chandramohan
SlateDB 0.6.0 is out!
github.com/slatedb/slat...
Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions.
Oh, and put performance jumped ~80% for write-heavy workloads :)
slatedb.io/performance/...
github.com/slatedb/slat...
Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions.
Oh, and put performance jumped ~80% for write-heavy workloads :)
slatedb.io/performance/...
April 24, 2025 at 7:05 PM
SlateDB 0.6.0 is out!
github.com/slatedb/slat...
Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions.
Oh, and put performance jumped ~80% for write-heavy workloads :)
slatedb.io/performance/...
github.com/slatedb/slat...
Highlights include a hybrid cache (using Foyer), a lot of internal cleanup, and more groundwork for transactions.
Oh, and put performance jumped ~80% for write-heavy workloads :)
slatedb.io/performance/...
Reposted by Vignesh Chandramohan
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
SlateDB - An embedded storage engine built on object storage | SlateDB
Description will go into a meta tag in <head />
SlateDB.io
April 22, 2025 at 9:55 PM
Today marks SlateDB’s one year anniversary! It’s been a lot of fun. Thanks to @rohanpd.bsky.social @flaneur2024.bsky.social @almog.ai @vigneshc.bsky.social @paulbutler.org Jason Gustafson, David Moravek, and many others for joining the project. 😀
Reposted by Vignesh Chandramohan
Commonhaus is 1! 🎂
14 projects, solid foundations, and more on the way.
If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building.
www.commonhaus.org/activity/253...
14 projects, solid foundations, and more on the way.
If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building.
www.commonhaus.org/activity/253...
🎂 Commonhaus Turns One — A Look Back, and the Road Ahead
Commonhaus Foundation celebrates its first anniversary and lays down expectations for its future
www.commonhaus.org
April 10, 2025 at 2:05 PM
Commonhaus is 1! 🎂
14 projects, solid foundations, and more on the way.
If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building.
www.commonhaus.org/activity/253...
14 projects, solid foundations, and more on the way.
If you believe in light governance, shared care, and thoughtful support for open source, come see what we’re building.
www.commonhaus.org/activity/253...
Reposted by Vignesh Chandramohan
Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :)
Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL.
www.rilldata.com/events/data-...
Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL.
www.rilldata.com/events/data-...
April 15, 2025 at 11:44 PM
Yo SF Bay Area #databs crew, want to talk lakehouses at a real Lake House? :)
Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL.
www.rilldata.com/events/data-...
Next week after Data Council, join the founders of @clickhouse.com, @motherduck.com, @startreedata.bsky.social, and @tobikodata.com to talk real-time databases and next-generation ETL.
www.rilldata.com/events/data-...
Reposted by Vignesh Chandramohan
SlateDB 0.5.0 is out!
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Release v0.5.0 · slatedb/slatedb
What's Changed
Refactor Block Tests to Use Table-Driven Test Cases by @samsond in #410
Update await calls in README.md by @criccomini in #425
chore: Apply table driven test for sst.rs by @jeffreyl...
github.com
March 17, 2025 at 5:23 PM
SlateDB 0.5.0 is out!
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
Features:
- Checkpoints
- Clones
- Read only client
- Split/merge database foundation
- TTL filtering on reads
- Last version with breaking byte format changes
By the numbers:
- 62 commits
- 2 new contributors
- 10 total contributors
github.com/slatedb/slat...
DEBS conference hosts a grand challenge every year. This year's challenge is detecting outliers in a stream of images from laser powder bed fusion.
The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time!
2025.debs.org/call-for-gra...
The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time!
2025.debs.org/call-for-gra...
CALL FOR GRAND CHALLENGE SOLUTIONS
DEBS2025
2025.debs.org
February 23, 2025 at 6:40 PM
DEBS conference hosts a grand challenge every year. This year's challenge is detecting outliers in a stream of images from laser powder bed fusion.
The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time!
2025.debs.org/call-for-gra...
The challenge involves submitting a kubernetes app (constraint: 2 cores 8 gb). Interesting to try if you have the time!
2025.debs.org/call-for-gra...
Reposted by Vignesh Chandramohan
Python Folks - which data/workflow engine has the best developer experience for packaging code? We have looked into - Modal, Beam, Airflow, Flyte, AWS Lambda, Prefect, Dagster and Spark. Haven’t seen any approach which is fast, reliable and intuitive.
December 17, 2024 at 4:09 PM
Python Folks - which data/workflow engine has the best developer experience for packaging code? We have looked into - Modal, Beam, Airflow, Flyte, AWS Lambda, Prefect, Dagster and Spark. Haven’t seen any approach which is fast, reliable and intuitive.
What are some papers or blogs about data quality challenges?
I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs.
Found this, are there others?
journalofbigdata.springeropen.com/articles/10....
I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs.
Found this, are there others?
journalofbigdata.springeropen.com/articles/10....
Big data quality framework: a holistic approach to continuous quality management - Journal of Big Data
Big Data is an essential research area for governments, institutions, and private agencies to support their analytics decisions. Big Data refers to all about data, how it is collected, processed, and ...
journalofbigdata.springeropen.com
January 19, 2025 at 7:27 PM
What are some papers or blogs about data quality challenges?
I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs.
Found this, are there others?
journalofbigdata.springeropen.com/articles/10....
I see tools like great expectations, table formats features like 'check constraints' in Delta. I don't yet see it as a first class property of catalogs.
Found this, are there others?
journalofbigdata.springeropen.com/articles/10....
Great talk by Binwei Yang on Apache Gluten last week.
youtu.be/GWTj3INSzPg?...
Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance.
It has basic iceberg support too!
github.com/apache/incub...
youtu.be/GWTj3INSzPg?...
Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance.
It has basic iceberg support too!
github.com/apache/incub...
Big Data Bellevue: Apache Gluten: Accelerating SparkSQL with Spark on Velox
YouTube video by BDB
youtu.be
January 19, 2025 at 2:06 AM
Great talk by Binwei Yang on Apache Gluten last week.
youtu.be/GWTj3INSzPg?...
Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance.
It has basic iceberg support too!
github.com/apache/incub...
youtu.be/GWTj3INSzPg?...
Apache Gluten moves execution of spark operators to native backend like Velox, accelerating query performance.
It has basic iceberg support too!
github.com/apache/incub...
Reposted by Vignesh Chandramohan
SlateDB 0.4.0 is out!
Features:
- Range scans
- No DynamoDB needed for S3
- Nightly perf tests
- Merge operator groundwork
- GC improvements
By the numbers:
- 57 commits
- 5 new contributors
- 11 total contributors
github.com/slatedb/slat...
Features:
- Range scans
- No DynamoDB needed for S3
- Nightly perf tests
- Merge operator groundwork
- GC improvements
By the numbers:
- 57 commits
- 5 new contributors
- 11 total contributors
github.com/slatedb/slat...
December 31, 2024 at 6:50 PM
SlateDB 0.4.0 is out!
Features:
- Range scans
- No DynamoDB needed for S3
- Nightly perf tests
- Merge operator groundwork
- GC improvements
By the numbers:
- 57 commits
- 5 new contributors
- 11 total contributors
github.com/slatedb/slat...
Features:
- Range scans
- No DynamoDB needed for S3
- Nightly perf tests
- Merge operator groundwork
- GC improvements
By the numbers:
- 57 commits
- 5 new contributors
- 11 total contributors
github.com/slatedb/slat...
Reposted by Vignesh Chandramohan
SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far.
github.com/commonhaus/f...
github.com/commonhaus/f...
SlateDB would like to join Commonhaus · commonhaus foundation · Discussion #213
Project information Project name: SlateDB Project website: https://slatedb.io Code repository: https://github.com/slatedb/slatedb License: Apache 2.0 Do you have authority to represent this project...
github.com
November 21, 2024 at 8:12 PM
SlateDB is now part of @commonhaus-fdn.bsky.social! I think we might be the first non-JVM project. Looking forward to more projects joining us here. Our experience with the foundation has been excellent so far.
github.com/commonhaus/f...
github.com/commonhaus/f...
Reposted by Vignesh Chandramohan
The 3 reasons to backfill:
1) new pipeline, who dis?
2) logic changed, recompute
3) whoops downstream lost everything. resend it.
1) new pipeline, who dis?
2) logic changed, recompute
3) whoops downstream lost everything. resend it.
November 16, 2024 at 2:09 AM
The 3 reasons to backfill:
1) new pipeline, who dis?
2) logic changed, recompute
3) whoops downstream lost everything. resend it.
1) new pipeline, who dis?
2) logic changed, recompute
3) whoops downstream lost everything. resend it.