Hell yeah @thegeeknarrator.bsky.social I’ve been really curious about what OpenData has been doing with SlateDB. Looking forward to listening to this! youtu.be/IAh3kmo2-9M?...

Many Databases 1 LSM Engine - OpenData

YouTube video by The Geek Narrator

youtu.be

If you understand the Math behind something, it becomes easier to understand. But understanding Math itself can be difficult, but totally worth it.

Assertions vs Types: Design by Contract, Deterministic Simulation Testing, and Safety vs Availability Vol. 3 of TigerStyle with matklad on @thegeeknarrator.bsky.social Thanks for having us, KV!

We’ve reached a point where managing digital cookies burns more calories than you’d gain from eating real ones. Such a pain 😵‍💫

If I ever design a system badly… I won’t admit.. But there will be signs. - Every software engineer ever.

1/12. I'm excited to share our latest technical blog post on ParadeDB. After a brief hiatus focused on transforming ParadeDB into an enterprise-ready database, expect to hear a lot more from us. Today's post: How ParadeDB built an LSM on top of Postgres block storage. 🧵

ParadeDB@paradedb.com · last yr.

The ParadeDB BM25 index brings Elastic-style full-text search to Postgres, powered by our custom Postgres-native LSM tree. Dive into how we built it: www.paradedb.com/blog/lsm_tre...

How do LSM trees work? Finally created a light board video. I hope you like it 🙏🏻 LSM Trees: How does it all work? youtu.be/CizxYuq-z6E

LSM Trees: How does it all work?

YouTube video by The Geek Narrator

youtu.be

Another advantage to designing systems as state machines: automated testing and even verification becomes dramatically easier.

What is State Machine thinking and how do I use it (practically)? State machine thinking is one of the best ways to build reliable software. The idea is to break down complex systems into discrete states and explicit transitions between them.

What is First principles thinking and how do I use it (practically) ?👇 First-principles thinking is one of the best ways to tackle complex problems. The idea is to break down complex problems into primitive elements and then reassemble the problem from scratch.

Small enough service is a micro-service. Large enough language model is a Large Language Model. Naming is a NP-hard problem.

Here is a sketch of how a solid observability platform built on top of object storage would look like this 👇 And guess what, Parseable is built exactly like that. All the good stuff that makes a system fast, reliable and highly scalable. New episode 🚀 youtu.be/MugLlrf5E_g

Diskless Kafka? But why? Why is it important for Kafka ecosystem ? How does it compare with existing revolutionary technologies? Blogged a comparison between Diskless Kafka, WarpStream and Confluent Freight. www.geeknarrator.com/blog/diskles...

Diskless Kafka? But why? Why is it important for Kafka ecosystem ? How does it compare with existing revolutionary technologies? Blogged a comparison between Diskless Kafka, WarpStream and Confluent Freight. www.geeknarrator.com/blog/diskles...

Blogged ✍🏻 Schema Driven Development with Buf www.geeknarrator.com/blog/buf-sch...

DUPLICATE events and painfully SLOW joins are a real and painful problems in the world of stream processing and realtime analytics. But why there hasn't been a simple, easy and fast solution for these problems that just works with the hassle?

DUPLICATE events and painfully SLOW joins are a real and painful problems in the world of stream processing and realtime analytics. But why there hasn't been a simple, easy and fast solution for these problems that just works with the hassle?

BLOGGED 🎉 - Diskless Kafka KIP-1150 Wrote a detailed blog on why I think diskless Kafka is going to be HUGE. Do check it out here: www.geeknarrator.com/blog/diskless-kafka-kip-1150 Thanks Aiven for sponsoring the blog.

There is a lot of innovation happening in the Databases world BUT one area where there is a lot of opportunities is Query optimisers. I recently learnt about query optimisers and the amazing work CMU db group is doing in this space with their new query optimiser “Optd”.

Are there Senior/Staff+ Engineers on my timeline who want to work on the intersection of #Databases, #Caches, #Infra, Kubernetes/Operators and #Scaling #Algorithms (think time series, predictive scaling etc)? If so, please drop me a DM. Our small but mighty team at ClickHouse is growing!

If someone says “I am a perfectionist”… they are either lying OR mean they are not going to get/let things done on time. The only realistic way is to be above a certain quality bar and keep the progress iterative and incremental. Get things done fast.

🎵 Sweet dreams are made of C++ 🎵 When something isn't working, sometimes you just need to rebuild it from scratch. That's what our Founding Panda, @emaxerrno.bsky.social, did when building Redpanda 🚀 Want to hear his story? Listen to Alex's chat with @thegeeknarrator.bsky.social in this episode 🎧

Redpanda - High Performance Streaming Platform for Data Intensive Applications @RedpandaData

YouTube video by The Geek Narrator

youtube.com

Thanks to @thegeeknarrator.bsky.social for having me! This was a fun podcast. 🚀

Feldera@feldera.bsky.social · last yr.

Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events. youtu.be/GpcIoABwF60?...

Listen to @thegeeknarrator.bsky.social podcast! @feldera.bsky.social CEO, @lalithsuresh.bsky.social, discusses Feldera's approach to incremental view maintenance and the foundational breakthrough -- DBSP -- that powers it, engine internals, storage, handling late events. youtu.be/GpcIoABwF60?...

Powering Incremental Compute with Mathematics - Feldera

YouTube video by The Geek Narrator

youtu.be

Listening to the DuckDB Internals with Mark Raasveldt (@markraasveldt.bsky.social) episode of The Geek Narrator podcast (@thegeeknarrator.bsky.social): www.youtube.com/watch?v=f9Ql...

@duckdb Internals with Mark Raasveldt @duckdb3282

YouTube video by The Geek Narrator

youtube.com

Just imagine writing a mature and massive system like #Kafka from scratch in C++. And on top, challenge yourself to make it 10x faster in tail latencies and way more cost effective.

Just imagine writing a mature and massive system like #Kafka from scratch in C++. And on top, challenge yourself to make it 10x faster in tail latencies and way more cost effective.

In this episode of @thegeeknarrator.bsky.social The GeekNarrator, Richard Artoul and Ryan Worl discuss: 🚀 WarpStream architecture. ✅ Kafka ordering guarantees. 🗜️ Buffering + compaction. 💸 WarpStream flexibility + cost efficiency.

WarpStream: A drop-in replacement for Kafka

In this episode of The GeekNarrator podcast, host Kaivalya Apte interviews Ryan and Richie, the founders of WarpStream. They discuss the architecture, benefi...

buff.ly

Learn the JVM internals 👇 1) The JVM Internals - Basics (Episode 1) youtu.be/Yg69qM0iZa4 2) JVM Internals: Heaps, Stacks, Program Counters and more youtu.be/MCTTg8VPaBY 3) JVM Internals - The Class file format youtu.be/15sz5yvQ-Po

The JVM Internals - Basics (Episode 1)

YouTube video by The Geek Narrator

youtu.be

We are focused on high-quality talks and expert speakers. Talks about engineering, not product pitches. Currently looking for speakers and venues that can host >50 people!

Gwen Shapira@gwenshap.bsky.social · last yr.

@chris.blue @apurvamehta.com Remember when we wanted a cool south-bay infra / papers meetup? Check out @southbaysystems.xyz meetup by @qianli.dev and friends.