Vignesh Chandramohan
vigneshc.bsky.social
Vignesh Chandramohan
@vigneshc.bsky.social
Stream processing, data infra, Table formats and Pickleball.

https://datapapers.substack.com/
It has three increasingly more verbose levels of description. They are probably trying to optimize the initial set of searches. And with markdown based skills, custom workflows are approachable for a broader audience compared to MCP, and probably safer too.
It is only available in Claude desktop.
October 31, 2025 at 2:40 AM
Tools, prompts, sampling - all these seem to be a result of generalizing how Claude code / research feature was built over time, and extracting ask out of those patterns. Uniformity is the biggest and probably only benefit.

And maybe the goal is not about solutions that spend less tokens?
September 29, 2025 at 10:48 PM
Intend to follow this along. Done with chapter 1, looking forward to the next one!
September 28, 2025 at 1:23 AM
2/ This mindset improves productivity and outcome significantly overtime.
September 27, 2025 at 8:59 PM
3/ And as an extension, how it handles maintenance operations such as vacuum on iceberg tables dones out of band.
August 24, 2025 at 2:20 PM
2/ I assume the iceberg writes uses iceberg open source libraries. This would ensure the write part continues to evolve with iceberg advancements.

I don't yet know if this handles compacted topics (which would introduce deletes on iceberg)
August 24, 2025 at 2:19 PM
1/ Leveraging Remote storage manager and storing Kafka segments as parquet files + iceberg metadata is really good. Avoids having to consume, serialize and manage a separate process.
I wonder if confluent's TableFlow launched about a year back has a similar design. www.confluent.io/blog/introdu...
Introducing Tableflow: Unifying Streaming and Analytics
Seamlessly integrate Apache Kafka data into your lakehouse as Apache Iceberg or Delta Lake tables, bridging the operational and analytical divide, with Tableflow. Read more in our blog post.
www.confluent.io
August 24, 2025 at 2:15 PM
Love the idea. Could some of these eventually become sub projects, and hosted in the SlateDB organization as a separate repo? Starting projects that have that potential as GitHub issues with a specific tag would make it easy to track.
July 7, 2025 at 1:37 AM
Got it. So, if I wanted a view to update, say once an hour incrementally, would I create a "hourly view" that uses now() and join against it?
May 27, 2025 at 4:53 PM
Clock tick as an input is indeed a way to model it! Would the clock tick table be joined in all views that need this property?
May 27, 2025 at 2:45 PM
Finally got to read this.
One additional aspect to ivm, is reasoning about the data in the computed. For a lot of use cases, it is often easy to think of a view/table to move in predictable increments (day, hour, 15 minutes etc). This notion is not modeled as a first class concept in many.
May 26, 2025 at 11:28 PM
Great episode!
Towards the end @vanlightly.bsky.social mentions about alloytools.org finding a data model bug.
Never thought of an intersection between data model and formal verification. Do you have more details on this?
February 15, 2025 at 4:06 AM