Feldera
banner
feldera.bsky.social
Feldera
@feldera.bsky.social
The incremental compute platform for data-intensive products
Introducing Feldera Health 🩺

A lightweight health monitoring solution built directly into Feldera. See the real-time status of your compiler, API server, and runner at a glance.

βœ… Available today on try.feldera.com and Enterprise Feldera
πŸ“ Detailed technical blog coming soon
January 22, 2026 at 7:00 PM
Incremental Updates - January 2026 edition is here! πŸš€

This edition covers:
- Product updates: adaptive join rebalancing, GC for ASOF joins and more
- New blogs: deep dive into our profiler, constant folding in Calcite, and a look back at our progress in 2025

www.linkedin.com/pulse/januar...
January Edition 2026
The past many months have been busy for us at Feldera. We continue to ship compounding improvements for our customers when it comes to usability, performance and efficiency.
www.linkedin.com
January 15, 2026 at 5:50 PM
🩻 X-ray vision for your SQL pipeline in Feldera.

-Click any node -> see metrics across all cores.
-Heat map shows bottlenecks instantly.
-Expand to trace back to your SQL code.

⚑ Seconds to see what used to take hours to find.

Dive deeper: www.feldera.com/blog/introdu...
December 23, 2025 at 9:38 PM
2025:
πŸ“¦ 166 unique releases, 1,162 changes, avg. new release every 2.4 days
πŸ“Š 10x cost reduction for users, hours old insights into sub-second latency
⚑ 70-node Spark clusters -> single digit Feldera instances

2026: Make incremental compute inevitable

Full story: www.feldera.com/blog/feldera...
Feldera in 2025: Building the Future of Incremental Compute
Feldera's 2025 year in review: comprehensive SQL support, state-of-the-art infrastructure, advanced connectors, and the future of real-time analytics.
www.feldera.com
December 19, 2025 at 6:59 PM
Because when you're processing millions of changes per second, you need to see what's happening to optimize it.

Read the technical deep-dive: www.feldera.com/blog/introdu...
A visualization tool for the runtime behavior of Feldera pipelines
We built a browser-based visualizer to dig into a Feldera pipeline's performance metrics. This tool can help users troubleshoot performance problems and diagnose bottlenecks.
www.feldera.com
December 11, 2025 at 5:44 PM
πŸ“Š Real-time metrics per operator: execution time, memory, data volumes, disk I/O
🎨 Visual dataflow graphs with color-coded performance heatmaps
πŸ” Interactive exploration - click any operator to see detailed breakdowns
December 11, 2025 at 5:44 PM
That’s why we built the Feldera profiler. It shows exactly where your computation time and resources are going.
December 11, 2025 at 5:44 PM
You can’t optimize what you can’t profile.

Which operators are a bottleneck? Are there skewed joins? Why is storage use spiking?

Our engineering team used to spend hours trying to answer these questions when performance problems would show up in the wild.
December 11, 2025 at 5:44 PM
They’re all available today. Now go build something fast. 🏎️
December 3, 2025 at 6:54 PM
Backfill avoidance: modifying a query used to mean having to recompute & backfill all over again. With backfill avoidance, you can avoid another backfill by reusing existing states when applicable, & recomputing only what’s new. Much faster than starting over.

docs.feldera.com/pipelines/mo...
Modifying a Pipeline While Preserving its State | Feldera Documentation
This feature is only available in Feldera Enterprise Edition.
docs.feldera.com
December 3, 2025 at 6:54 PM
Fast backfill (HUGE steps): you know backfilling historical data can take forever. That's why we shipped a transaction API where you control the batch size - whether small or HUGE - for efficient bulk ingests.

docs.feldera.com/pipelines/tr...
Efficient Bulk Data Processing using Transactions | Feldera Documentation
Transaction support is an experimental feature and may undergo significant
docs.feldera.com
December 3, 2025 at 6:54 PM
Parallel compilation: we used to compile pipelines one at a time. Now we distribute the workload across multiple servers. Pipeline builds that were queued back-to-back can now complete simultaneously within minutes. It shaved an hour off of our CI pipeline!

docs.feldera.com/get-started/...
Parallel Compilation | Feldera Documentation
Parallel compilation allows Feldera to compile multiple pipelines concurrently by distributing the workload across several compiler server pods. This dramatically reduces total compile time for large ...
docs.feldera.com
December 3, 2025 at 6:54 PM
Rust Compilation can be slow. Backfills can take days. And no one likes to wait. ⏳

We’ve recently shipped features that will get you deploying faster and scaling more efficiently:

- Parallel Compilation
- Fast Backfill
- Backfill Avoidance
December 3, 2025 at 6:54 PM
If you’re excited about hard technical problems and want to shape the future of real-time systems, Feldera is hiring (remotely!) for a Solutions Engineer (Enterprise) and a Software Engineer (Reliability, Performance)

jobs.ashbyhq.com/feldera/544a...
Jobs
jobs.ashbyhq.com
September 6, 2025 at 12:57 AM
Reposted by Feldera
Some of my work at @feldera.bsky.social involves containers. I keep getting spam from some vendor who wants to sell me casters to put on the containers 🀣
September 2, 2025 at 3:22 PM
"This is the true power of incremental compute. By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics."

πŸ‘‡

www.feldera.com/blog/how-fel...
How Feldera Customers Slash Cloud Spend (10x and beyond)
By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics.
www.feldera.com
August 20, 2025 at 5:01 PM
Reposted by Feldera
At @feldera.bsky.social I've been doing a lot of performance work. I needed an easy way to watch the Prometheus metrics for a pipeline, so I wrote a simple tool for the Feldera CLI that shows the pipeline metrics. Here's the progress of a pipeline that runs in about 30 seconds.
August 20, 2025 at 12:27 AM
If you've written even the most basic compute program, you've likely already written programs that "integrate".

Integration is central to Feldera and its underlying theory of incremental compute. It is also all around us in the real world! πŸ‘‡
Stream Integration
In this blog post we informally introduce one core streaming operation: integration. We show that integration is a simple, useful, and fundamental stream processing primitive, which is used not only…
www.feldera.com
August 18, 2025 at 3:14 PM
The future of data security isn't about choosing between compliance and performance. It's about making security a performance feature.

Learn how to implement fine-grained authorization without performance penalties: docs.feldera.com/use_cases/fi...
August 5, 2025 at 2:30 PM
What if you could have both security AND speed?
Modern fine-grained authorization embeds security directly into data processing, delivering:

- Microsecond authorization decisions
- Real-time row/column-level filtering
- Automated compliance reporting
- Actually improved query performance
August 5, 2025 at 2:30 PM
What are some the the typical challenges?
- 300-500ms latency added per query
- Complex compliance audits taking weeks
- Manual permission tracking via spreadsheets
- Performance degradation with granular controls
August 5, 2025 at 2:30 PM
Traditional authorization systems force an impossible trade-off: secure data access OR fast query performance. With SOX compliance audits intensifying and data breach costs averaging $4.45M, this choice is becoming a business risk.
August 5, 2025 at 2:30 PM
"We chose performance over security" - a dilemma no data team should face.

#DataEngineering #DataSecurity #RealTimeAnalytics
August 5, 2025 at 2:30 PM
New tech talk:

How to Incrementally Get Results from Your Graph Data with Feldera.

Interested in practical techniques for incremental computation or want to see how this fits into modern data engineering workflows?

Check it out: youtu.be/vpVAZbaZ2Hg
How to Incrementally Get Results from Your Graph Data with Feldera
YouTube video by Feldera, Inc.
youtu.be
June 18, 2025 at 7:47 PM
Mihai Budiu, our exceptional Chief Scientist, won the 2025 #ACM #SIGCOMM Networking Systems Award for his groundbreaking work on #P4.

Details: www.sigcomm.org/awards/sigco...
June 17, 2025 at 5:22 PM