Once you've experienced a True Incremental View Maintenance (IVM) engine, recomputing everything from scratch sounds absolutely absurd. Too slow and too expensive to justify. We set up a little match of our own: Databricks Incrementally Materialized Views vs. Feldera.
Lalith Suresh
@lalithsuresh.bsky.social
CEO @ feldera.com, the incremental compute engine for AI, ML and data teams. Formerly a systems researcher in distributed systems, databases, cloud, OS, PL, and networking. Sci-fi and gaming nerd. lalith.in/research
Right now, somewhere, a data engineer is getting another message from stakeholders: “Why is the Gold layer late?” It is a familiar reminder that the traditional medallion architecture was not built for real-time freshness. It is being held back by legacy batch processing.
Databricks Data + AI Summit is the one place where everyone in the room knows the medallion architecture intimately, and nobody talks about what it actually costs you to keep it fresh.
March was a month of depth. We went deep on engine performance, observability, and reliability. Read the full newsletter here: www.linkedin.com/pulse/march-...
March Edition 2026
March was a month of depth, we went deep on engine performance, observability, and reliability. Here’s what shipped.
linkedin.com
one thing i appreciate about Apple's commitment to privacy is the absolute ironclad secrecy with which they treat the questions "what shows are on AppleTV" and "when do the seasons start"
Xooglerware: a genre of software built by former Googlers. Key traits: Uses Bazel & protobuf (but strangely most protobuf v2), written in either Go or Java, uses 17TB of memory, burns three forests due to a clever algorithm, requires you to know the author as a friend to one-shot compilation
Making Copilot code review the PR replacing it with Claude Code review is kind of macabre. github.com/feldera/feld...
[ci] switch to claude code review by gz · Pull Request #5574 · feldera/feldera
github.com
If you're a recent PhD graduate and have published in systems venues (SOSP, OSDI, NSDI, etc), let me know and I'll nominate you for PC invites when I get them. I regret that I'm unable to carve out time to be on PCs these days. It was one of my favorite parts of being a researcher.
Introducing Feldera Health 🩺 A lightweight health monitoring solution built directly into Feldera. See the real-time status of your compiler, API server, and runner at a glance. ✅ Available today on try.feldera.com and Enterprise Feldera 📝 Detailed technical blog coming soon
Incremental Updates - January 2026 edition is here! 🚀 This edition covers: - Product updates: adaptive join rebalancing, GC for ASOF joins and more - New blogs: deep dive into our profiler, constant folding in Calcite, and a look back at our progress in 2025 www.linkedin.com/pulse/januar...
January Edition 2026
The past many months have been busy for us at Feldera. We continue to ship compounding improvements for our customers when it comes to usability, performance and efficiency.
linkedin.com
I feel like I haven’t even been properly lied to about the purposes of this war
This is how @benpfaff.bsky.social is kicking off the New Year! 🚀
Initial support for multihost pipelines by blp · Pull Request #5358 · feldera/feldera
github.com
pretending I am using the force to open the automatic doors at the grocery store is the only joy I have left
Reporter: our story about the huge sewage spill in the middle of the city is ready to go Bari Weiss: no, wait. I want to interview the sewage first
2025: 📦 166 unique releases, 1,162 changes, avg. new release every 2.4 days 📊 10x cost reduction for users, hours old insights into sub-second latency ⚡ 70-node Spark clusters -> single digit Feldera instances 2026: Make incremental compute inevitable Full story: www.feldera.com/blog/feldera...
Feldera in 2025: Building the Future of Incremental Compute
Feldera's 2025 year in review: comprehensive SQL support, state-of-the-art infrastructure, advanced connectors, and the future of real-time analytics.
feldera.com
You can’t optimize what you can’t profile. Which operators are a bottleneck? Are there skewed joins? Why is storage use spiking? Our engineering team used to spend hours trying to answer these questions when performance problems would show up in the wild.
MORPHEUS: They're coming for you, Neo. I can guide you, but you must do exactly as I say. Take the elevator to the lobby and go to the CVS across the street. Purchase 5 Steam gift cards at $200 each. Scratch off the protective coating on the back and tell me the fifteen digit redemption codes. Hurry
Remember folks, during winter every ten degree temperature drop lowers your tire’s PSI by 1 so it’s very important to go to the gas station and notice that the air thing doesn’t work and then do that five more times at five different gas stations
Rust Compilation can be slow. Backfills can take days. And no one likes to wait. ⏳ We’ve recently shipped features that will get you deploying faster and scaling more efficiently: - Parallel Compilation - Fast Backfill - Backfill Avoidance
Has anyone managed to run perf on EKS without running the pods with full privileges? (e.g., with only CAP_PERFMON)
Introducing the iCheeseGrater (seriously why is this the first image)
My sympathies are with every South Asian child that now has to hear their parents tell them they need to be a "doctor, lawyer, or mayor of New York"
One of the huge perks of working at a software company is, when there's something about the product that bothers you personally, you can get your hands dirty and find out why it's basically impossible to get fixed
Really looking forward to the Speaker of the House claiming to be unaware of the election results.
It's a good sign these days when 99.9% of customer support questions can be traced to Karpenter wrecking the customer's infra.
Trying to pick a game to play and this is one of claude's suggestions.