Lalith Suresh

@lalithsuresh.bsky.social

CEO @ feldera.com, the incremental compute engine for AI, ML and data teams. Formerly a systems researcher in distributed systems, databases, cloud, OS, PL, and networking. Sci-fi and gaming nerd. lalith.in/research

Once you've experienced a True Incremental View Maintenance (IVM) engine, recomputing everything from scratch sounds absolutely absurd. Too slow and too expensive to justify. We set up a little match of our own: Databricks Incrementally Materialized Views vs. Feldera.

BildBildBildBild

Right now, somewhere, a data engineer is getting another message from stakeholders: “Why is the Gold layer late?” It is a familiar reminder that the traditional medallion architecture was not built for real-time freshness. It is being held back by legacy batch processing.

Databricks Data + AI Summit is the one place where everyone in the room knows the medallion architecture intimately, and nobody talks about what it actually costs you to keep it fresh.

We will be at Databricks Data + AI Summit. June 15-18, 2026

Xooglerware: a genre of software built by former Googlers. Key traits: Uses Bazel & protobuf (but strangely most protobuf v2), written in either Go or Java, uses 17TB of memory, burns three forests due to a clever algorithm, requires you to know the author as a friend to one-shot compilation

Many of the #rust floating-point math functions have a note: "The precision of this function is non-deterministic. This means it varies by platform, Rust version, and can even differ within the same execution from one invocation to the next." When would results vary between invocations? #rustlang

If you're a recent PhD graduate and have published in systems venues (SOSP, OSDI, NSDI, etc), let me know and I'll nominate you for PC invites when I get them. I regret that I'm unable to carve out time to be on PCs these days. It was one of my favorite parts of being a researcher.

Introducing Feldera Health 🩺 A lightweight health monitoring solution built directly into Feldera. See the real-time status of your compiler, API server, and runner at a glance. ✅ Available today on try.feldera.com and Enterprise Feldera 📝 Detailed technical blog coming soon

Incremental Updates - January 2026 edition is here! 🚀 This edition covers: - Product updates: adaptive join rebalancing, GC for ASOF joins and more - New blogs: deep dive into our profiler, constant folding in Calcite, and a look back at our progress in 2025 www.linkedin.com/pulse/januar...

January Edition 2026

The past many months have been busy for us at Feldera. We continue to ship compounding improvements for our customers when it comes to usability, performance and efficiency.

linkedin.com

2025: 📦 166 unique releases, 1,162 changes, avg. new release every 2.4 days 📊 10x cost reduction for users, hours old insights into sub-second latency ⚡ 70-node Spark clusters -> single digit Feldera instances 2026: Make incremental compute inevitable Full story: www.feldera.com/blog/feldera...

Feldera in 2025: Building the Future of Incremental Compute

Feldera's 2025 year in review: comprehensive SQL support, state-of-the-art infrastructure, advanced connectors, and the future of real-time analytics.

feldera.com

You can’t optimize what you can’t profile. Which operators are a bottleneck? Are there skewed joins? Why is storage use spiking? Our engineering team used to spend hours trying to answer these questions when performance problems would show up in the wild.

MORPHEUS: They're coming for you, Neo. I can guide you, but you must do exactly as I say. Take the elevator to the lobby and go to the CVS across the street. Purchase 5 Steam gift cards at $200 each. Scratch off the protective coating on the back and tell me the fifteen digit redemption codes. Hurry

Bild

Remember folks, during winter every ten degree temperature drop lowers your tire’s PSI by 1 so it’s very important to go to the gas station and notice that the air thing doesn’t work and then do that five more times at five different gas stations

Rust Compilation can be slow. Backfills can take days. And no one likes to wait. ⏳ We’ve recently shipped features that will get you deploying faster and scaling more efficiently: - Parallel Compilation - Fast Backfill - Backfill Avoidance

My sympathies are with every South Asian child that now has to hear their parents tell them they need to be a "doctor, lawyer, or mayor of New York"

One of the huge perks of working at a software company is, when there's something about the product that bothers you personally, you can get your hands dirty and find out why it's basically impossible to get fixed