If you missed today's webinar where Christian Minich dives deep on how he leverages AI when building projects for prospective Dagster users, then you can find the recording here! www.youtube.com/watch?v=_o7d...
I wrote an Almanack like Charlie Munger and Naval Ravikant did, but about life wisdom and my time of using Dagster for data orchestration over the years. Since using it in 2018, the story has gone from complexity to composability and from orchestrating to a full data platform.
If you're a Python developer using Claude Code, or something similar, we just published a blog that covers 10 rules we add to our prompt for drastically improved code gen. And we include the full prompt at the end of the post! dagster.io/blog/dignifi...
We've been improving how we create educational content at @dagster.io: optimizing feedback loops, generating content for different learning styles, and leveraging LLM-powered workflows. You can find our lessons learned on the @allthingsopen.bsky.social "We Love Open Source" blog!
New book dropped!
Christian Minich@christianminich.com · 9mo ago“Flexibility without fragmentation” In addition to some solid alteration, it’s also a great explanation of how to build a data team and how your system can and should scale. @colton.boo and Dennis Hume have an awesome new ebook on this topic, check it out! #dataBS dagster.io/how-to-scale...
Otto's data teams were stuck. Some drowning in endless Argo YAML configurations, others testing directly in production. When your data platform fights against good practices, your teams waste time on operational overhead instead of building value. dagster.io/blog/otto-ca...
Stop rebuilding data pipelines from scratch every time. We're doing a technical deep dive with our friends at dlthub team to show you exactly how this works in practice. Perfect for data engineers tired of reinventing the wheel on every project. dagster.io/events/devel...
The best data tools are built by practitioners, for practitioners. That's why we're excited to team up with our friends over at dlthub for a deep dive on July 8th (11 AM ET). We'll focus on patterns you can actually use, not just admire. Register today! dagster.io/events/devel...
🚨 Deep Dive Alert 🚨 Orchestrating bioinformatics workflows is where traditional pipeline tools go to die. Keith Kam from Basecamp Research learned this while building BaseData™ – managing complex genomic pipelines that power bio AI models. Register today! lp.dagster.io/basecamp-res...
Connect 211 faced a classic data engineering challenge: building a platform to standardize health and human services data from hundreds of legacy systems. Their team was struggling with Airflow's fragmented visibility across their pipelines. Check out their case study! dagster.io/blog/connect...
Hear from our Community! Bolin recently worked with us to complete a case study about Stashaway's success since implementing Dagster. Read the full story today! Link in the thread. dagster.io/blog/stashaw...
Hear from our Community! As Martin explains to his C-suite, this flexibility enables his team to meet their organizational needs without being constrained by the platform. Additionally, Dagster's data observability features have helped his team catch and resolve issues. Thanks Martin!
On April 15th, Our Founder and CTO Nick Schrock will be hosting a live webinar where he will explain the vision behind components and How Dagster is building the future of data platform engineering. Register today! lp.dagster.io/components
Dagster University Update 🎓 In an effort to make Dagster University more accessible, we have added support for GitHub Codespaces! Now, you can learn Dagster without having to worry about some of the frustrations that come with local Python development. courses.dagster.io
Hear from our Community! Steven Ayers is a Principal Engineer at Ayersio Services Limited and has been a Dagster fan for quite some time. With Dagster's asset-centric approach, how you think and talk about your data is aligned to how you build with it.
Dagster's project Airlift makes it easy to observe and migrate Apache Airflow pipelines to Dagster, bringing a ton of value! youtube.com/shorts/9UF64...
In case you missed our Deep Dive with Lee Littlejohn from US Foods Yesterday the full recording is now live on Youtube. youtu.be/hoVvlgUYkM8
🚨 New Course Alert 🚨 We are pleased to announce that the new "Testing with Dagster" course is now live on Dagster University. dagster.io/blog/dagster...
Hear from our Community! Ismael Rodrigues is a Lead Data Engineer at C&A Modas and has been a Dagster fan for quite some time. Dagster was built with modern data work in mind; that's why we make it easy to bring whatever data process you need into the framework. Thanks Ismeal!
We understand that your data platform is highly contextual, and you need a tool to accommodate this. Components provide a low-code YAML interface for your users, backed by tools that support software engineering best practices and give platform teams complete control. lp.dagster.io/components
Hear from our Community! Emil Sundman is a Data Engineer at Bizware and an experienced data professional across the entire data stack. Thanks Emil!
We're pleased to announce that Dagster has officially earned Snowflake Technology Industry Competency status. This milestone validates our position as a critical component in modern data ecosystems!
Shivanshu Gupta is a Data Engineer at Chainalysis, where they run Dagster to orchestrate and maintain complex data pipelines. 🔍 In today's data landscape, engineers like Shivanshu need tools that reduce cognitive load while handling increasingly complex pipelines.
The Dagster community is full of powerful data professionals who are building data platforms that fuel the modern world. Lee will join us for a Deep Dive on April 1st. Register to learn how to replicate his success in your organization. lp.dagster.io/deep-dive-us...
Join us on April 1st for a deep dive into how Lee Littlejohn built a data platform at US Foods with Dagster! Lee applies kitchen principles to data: minimizing action, reusing components, and creating a single source of truth. lp.dagster.io/deep-dive-us...
🚀 Want to preview the brand new `dg` cli, and a framework for building and working with YAML DSLs built on top of Dagster called "Components"? You can find a link to demo videos and a GitHub discussion in the thread!
Joe Naso and I just published an e-book covering the essential topics needed to build a data platform! Check it out if you're looking to learn more about data modeling, ingestion patterns, and common data architectures. dagster.io/how-to-build...
📚 NEW EBOOK: Data Platform Fundamentals While every organization's technical stack may differ, the underlying patterns and principles for success remain consistent. Download the ebook today! dagster.io/how-to-build...
🔍 NEW BLOG: From Prototype to Production - Building AI Products That Scale with Dagster The AI revolution isn't just about models—it's about engineering practices that make AI reliable in production. Read the full post on building AI applications that scale today! https://buff.ly/3QwvtcL
