📣 In case you missed it! We recently hosted a deep dive on how 𝗖𝗼𝗻𝗳𝗹𝘂𝗲𝗻𝘁 𝗧𝗮𝗯𝗹𝗲𝗳𝗹𝗼𝘄 and the 𝗗𝗲𝗹𝘁𝗮 𝗞𝗲𝗿𝗻𝗲𝗹 automate the move from Kafka to Databricks Unity Catalog—eliminating the need for fragile, manual ETL. 🎥 Catch the full replay on YouTube: youtube.com/live/Q8yxLKh... #opensource #deltalake
Delta Lake
@deltalakeoss.bsky.social
Delta Lake is an open-source storage framework that enables building a Lakehouse architecture for Spark, Flink, Trino, Hive, Scala, Java, Rust, Python, & more.
1 WEEK AWAY ➡️ 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲: 𝗧𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲 - 𝟭 𝗬𝗲𝗮𝗿 𝗔𝗻𝗻𝗶𝘃𝗲𝗿𝘀𝗮𝗿𝘆 𝗩𝗶𝗿𝘁𝘂𝗮𝗹 𝗖𝗲𝗹𝗲𝗯𝗿𝗮𝘁𝗶𝗼𝗻! 🎉 Join us next Wednesday, December 17th, as we celebrate a huge milestone: the one-year anniversary of the publication of Delta Lake: The Definitive Guide! 🙌 🔗 Secure your spot: luma.com/1yearcelebra... #oss
Delta Lake: The Definitive Guide 🎉 1 Year Anniversary Virtual Celebration! · Luma
🎉 Delta Lake: The Definitive Guide - 1 Year Anniversary Virtual Celebration! We are thrilled to invite you to a special virtual event celebrating the one-year…
luma.com
🎉 It’s been one year since the release of 𝗗𝗲𝗹𝘁𝗮 𝗟𝗮𝗸𝗲: 𝗧𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲, and we’re throwing a virtual party to celebrate the milestone! 🔹 𝗖𝗲𝗹𝗲𝗯𝗿𝗮𝘁𝗲 𝘁𝗵𝗲 𝗗𝗲𝗳𝗶𝗻𝗶𝘁𝗶𝘃𝗲 𝗚𝘂𝗶𝗱𝗲 🔹 𝗔𝘀𝗸 𝗨𝘀 𝗔𝗻𝘆𝘁𝗵𝗶𝗻𝗴 (𝗔𝗨𝗔) 🔹 𝗦𝘄𝗮𝗴 𝗚𝗶𝘃𝗲𝗮𝘄𝗮𝘆 📅 Dec 17 ⏰ 9:00AM PT 🔗 Register: luma.com/1yearcelebra... #deltalake #opensource #oss
Delta Lake: The Definitive Guide 🎉 1 Year Anniversary Virtual Celebration! · Luma
🎉 Delta Lake: The Definitive Guide - 1 Year Anniversary Virtual Celebration! We are thrilled to invite you to a special virtual event celebrating the one-year…
luma.com
We’re diving deep into Flight SQL + Delta to show how open technologies like Apache Arrow Flight, #DataFusion, & Delta Lake are reshaping high-performance analytics. 🚀 🗓️ Nov 11 🕝 9:00 AM PT 🔗 RSVP: luma.com/delta-1111 Get ready to see data exchange the way it should be — fast, distributed, & open.
Flight SQL + Delta: Building the Future of High-Speed Data Exchange · Luma
Join us for an in-depth, interactive session on Flight SQL and Delta integration, showcasing how open technologies like Apache Arrow Flight, DataFusion, and…
luma.com
Did you know you can easily enable Variant Type in existing Delta tables? 💡 Just run an ALTER TABLE command to activate the Delta feature: `variantType`. Watch the full webinar ➡️ www.youtube.com/live/0BfUG2P... #DeltaLake #OpenSource #OSS
Open Lakehouse + AI spotlight: @hannes.muehleisen.org shares how anyone can contribute to DuckDB & DuckLake—both MIT-licensed, open source, & welcoming PRs and community engagement on GitHub. Check out this clip to hear how easy it is to get involved and start contributing today. 🚀 #openlakehouse
⏰ Final reminder: Delta Lake webinar tomorrow! Can data engineering patterns unlock new Delta Lake insights? How can it power streaming architectures? Join Scott Haines & Bartosz Konieczny as they tackle these questions head-on! 🔗 RSVP: luma.com/delta-1014 #opensource #oss #deltalake #streaming
Diving into Streaming Data Design Patterns for Delta Lake · Luma
Are you wondering if general concepts like data engineering design patterns can help you learn about Delta Lake? Or, if it's possible to leverage Delta Lake…
luma.com
📣 Join us for our next 𝗢𝗽𝗲𝗻 𝗟𝗮𝗸𝗲𝗵𝗼𝘂𝘀𝗲 + 𝗔𝗜 webinar on October 30 at 9AM PT! Lineage graphs are complex and low-context. Collecting isn’t the problem—understanding is. Learn how a reasoning layer connects lineage + telemetry into continuous context. RSVP ➡️ luma.com/openlakehous... #openlakehouse
The Failed Promises of Data Lineage: Why More Metadata Isn’t the Answer · Luma
The data world doesn’t need more lineage graphs. Most are overly complex and lack meaningful context. After years of chasing “total visibility,” we’ve learned…
luma.com
One of the most powerful new capabilities in Delta Lake 4.0 is support for collations, giving you much finer control over how text is compared and sorted. ✅ In this clip, Youssef Mrini explains how to enable collations. 🎥 Watch the full webinar: youtube.com/live/0BfUG2PZyNs?si=nzcalgk1gvOEFBrY
One week to go! 🥳 Curious how data engineering design patterns translate to Delta Lake, & how it fits into streaming architectures? Join us for a walkthrough of the patterns, features, & best practices powering reliable streaming with #DeltaLake. 🗓️ Oct 14 🕝 9AM PT 🔗 RSVP: luma.com/delta-1014 #oss
Diving into Streaming Data Design Patterns for Delta Lake · Luma
Are you wondering if general concepts like data engineering design patterns can help you learn about Delta Lake? Or, if it's possible to leverage Delta Lake…
luma.com
Tomorrow, Oct 7 at 9AM PT! Join Ciro Greco & Jacopo Tagliabue from bauplan for a live webinar on how function-based execution & Git-for-Data are reshaping lakehouses for autonomous AI agents. ✅ Don’t miss the future of agentic data ops! Secure your spot ➡️ luma.com/OLAI-107 #opensource #lakehouse
From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future · Zoom · Luma
The lakehouse promises a unified platform for analytics, ML, and governance. While modern catalogs offer unified governance, the same uniformity is still…
luma.com
Delta Connect is a plugin atop Spark Connect, introduced in Spark 3.4, and enables gRPC communication using Protocol Buffers. ✅ This allows client implementations in languages such as Rust and Go to interact with Spark outside the JVM, provided they support the protocol. #opensource #oss #deltalake
At Open Lakehouse + AI Amsterdam last month, Sammy Sidhu—co-creator of the Daft multi-modal query engine and CEO of Eventual—shared how his open source journey began. 🚀 Ready to shape the future of data, open source, and AI together? Join us at our next Open Lakehouse + AI events! ⬇️ #opensource
🚀 Happening today, Sept 30 at 9AM PT! Join us for a behind-the-scenes look at the Delta Rust Kernel with R. Tyler Croy, Robert Pack, and Scott Haines. Discover how #DeltaLake’s core is evolving with powerful new features like column mapping and deletion vectors. 👉 Register now: luma.com/delta-0930
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
🚨 Happening tomorrow! Get an inside look at how the new Delta Rust kernel is transforming Delta Lake. Learn how it solves fragmentation, enables column mapping & deletion vectors, and why it matters—even if you don’t touch the kernel. Register ➡️ luma.com/delta-0930 #opensource #deltalake #oss
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
“Open source is giving back, because it means everyone who supports our work can participate and benefit from the software we are making." — @hannes.muehleisen.org (@duckdb.org) at Open Lakehouse + AI Amsterdam 🇳🇱 Ready to shape the future of data, open source, and AI together? ⬇️ #opensource #oss
Dropping features in #DeltaLake used to break table compatibility and history. Delta 4.0 fixes this by protecting checkpoints and rewriting recent history—keeping tables safe and stable. 💪 🎥 Watch the full webinar replay: www.youtube.com/watch?v=0BfU... #opensource #oss
Delta Lake has evolved—fragmentation is out, the new Rust kernel is in. 🚀 Join R. Tyler Croy, Robert Pack & Scott Haines to explore fixes to past issues, new features (column mapping + deletion vectors), and why it matters. 📅 Sept 30 🕜 9AM PT 🔗 Register: luma.com/delta-0930 #DeltaLake #Rust #OSS
Exploring Delta's Rust Kernel: A behind the scenes exploration of what secretly powers delta-rs · Luma
The Delta Lake ecosystem has evolved significantly since 2021, becoming more complex while facing fragmentation challenges across different engine…
luma.com
🚨 Only a couple hours to go — Find out what's new in #DeltaLake 4.0! 🎥 LIVE on LinkedIn, X & YouTube 🗓️ Sept 16 🕑 9AM PT / 12PM ET 🔗 Register now: luma.com/delta-0923 #opensource #oss #linuxfoundation
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma
Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…
luma.com
Missed the Delta Live! Rust hacking sessions with R. Tyler Croy and Robert Pack? 🤔 Catch up on the action as they dive into Rust development for Delta Lake, showcasing real-time coding, debugging, and problem-solving. 🎥 Watch here: youtube.com/playlist?lis... #opensource #deltalake #livehacking
Delta Lake Live! - YouTube
youtube.com
The countdown is on—our Delta 4.0 webinar is next week! 🚀 Join Youssef Mrini and Scott Haines as they explore the powerful new features in Delta 4.0 that can transform how you design and optimize data workflows. 🗓️ Tuesday, Sept 16 🕝 9:00AM PT 🔗 Save your spot: luma.com/delta-0923 #oss #deltalake
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma
Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…
luma.com
Upcoming Webinar ➡️ Exploring Delta’s Rust Kernel: a look behind the scenes at what powers delta-rs! Join R. Tyler Croy, Robert Pack & Scott Haines to learn how kernel changes deliver consistency, new features & faster performance for Delta engines. 📅 Sept 30 @ 9AM PT 🔗 RSVP: luma.com/delta-0930
📣 Mark your calendar for Tuesday, October 7 at 9AM PT for the next Open Lakehouse + AI webinar: “From Functions to AI Agents: Reimagining the Lakehouse for an Agentic Future!” 🚀 🔗 Register here: luma.com/OLAI-107 #opensource #deltalake #agentic #aiagents #oss
Excited to announce Delta Live! Live Rust Hacking and AMA — streaming tomorrow, Sept 9 on Twitch. 👏 Join R. Tyler Croy and Robert Pack for a hands-on Rust session and live Q&A! 📅 Sept 9 ⏰ 7AM PT / 10AM ET 🔗 twitch.tv/agentdero Bring your questions and gain insights from #DeltaLake maintainers. 🦀
Delta 4.0 brings powerful new features that can reshape how you design and optimize your data workflows. 🚀 Join Youssef Mrini & Scott Haines as they break down their favorite features! 🗓️ Tuesday, Sept 16 🕝 9:00 AM PT 🔗 RSVP: luma.com/delta-0923 #opensource #oss #deltalake #linuxfoundation
Delta Lake is Growing Up: Diving into Our Favorite Features of Delta 4.0 · Luma
Delta 4.0 is here and we’re really excited to share our favorite new features with you. In this session, join Youssef Mrini and Scott Haines as they walk you…
luma.com
The first-ever Open Lakehouse + AI Meetup in Amsterdam was a huge success! 🙌🇳🇱 The evening brought together the open source and data engineering community to explore the latest advancements in open lakehouse and AI architectures. 🚀
🚨 Happening TODAY, August 26 at 7AM PT! Join R. Tyler Croy (Buoyant Data) & Robert Pack (Databricks) for live Rust hacking and get answers to all your #DeltaLake questions — streaming LIVE on Twitch! 🎥 Tune in: www.twitch.tv/agentdero #rustlang #rust #kernel
🚨 This Week: Open Lakehouse Meetup – Amsterdam! Last chance to join Amsterdam’s open source and data engineering community for an evening of hands-on learning and fresh ideas about the future of open lakehouse systems. 🙌 🗓 Wednesday, August 27 ⏰ 5-9PM 📍 Amsterdam 🔗 Register now: lu.ma/OLM-827
Join R. Tyler Croy, Delta Lake maintainer and founder of Buoyant Data, for “Delta Live! Live Rust hacking and AMA” 🦀 on Twitch. 📅 Tuesday, August 19 ⏰ 7:00AM PT / 10:00AM ET Tune in here ➡️ twitch.tv/agentdero #opensource #deltalake #oss #rust #rustlang
🇳🇱 Join us in Amsterdam on August 27 for the Open Lakehouse Meetup! Discover how your #lakehouse is ready for production-scale multimodal ML pipelines in "Your Lakehouse Has Everything You Need" with Sammy Sidhu, CEO & Co-Founder of Eventual! 🔗 Register now to save your spot: lu.ma/OLM-827 #oss