Tessera

Some of us met in Denver for an Apache DataFusion meetup last week. Here are the slides and videos: github.com/apache/dataf...

I spent all afternoon trying to just catch up on unread github alerts and I still have more than 50 😭 -- there is so much good stuff waiting to be reviewed

"Treat Skills as software" -- that any many other Gems in Tim Saucers recent interview with Plus One plusone.apache.org/2026/07/14/d...

DataFusion Python, with Tim Saucer

Tim Saucer, PMC member and primary maintainer of Apache DataFusion’s Python bindings, joins PlusOne to talk about how he went from frustrated Spark user to open source maintainer — and how th…

plusone.apache.org

Can you accelerate queries when your data is *partially* sorted (and e.g. you don't want to have to resort it). Yes. Qi Zhu and I explain how in: datafusion.apache.org/blog/2026/07...

Andrew Lamb @andrewlamb1111.bsky.social · 3w ago

The Apache DataFusion 54.0.0 release (2 months of development had 139 distinct contributors. 🤯 github.com/apache/dataf...

Nice example of evaluating filters on compressed data: This post from Martin Prammer and @spiraldb.com is a spiraldb.com/blog/pattern...

Pattern Matching on Compressed Strings without Decompression

Evaluating SQL LIKE directly on FSST-compressed strings: a symbol-aware automaton and a SIMD prefilter let Vortex match without decompressing the column first.

spiraldb.com

Andrew Lamb @andrewlamb1111.bsky.social · 3w ago

Last chance to sign up for our Apache DataFusion meetup next week in Denver, CO: luma.com/jsu6faie

Denver Apache DataFusion Meetup · Luma

Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

luma.com

Andrew Lamb @andrewlamb1111.bsky.social · 3w ago

DataFusion is now a real thing -- en.wikipedia.org/wiki/Apache_...

Apache DataFusion - Wikipedia

en.wikipedia.org

I recently joined Rich Bowen of the ASF to talk about Apache DataFusion's origins and increasing popularity YouTube is at youtu.be/6E5ER09F5SQ Just audio at wp.me/p8gHED-57w

Apache DataFusion, with PMC Chair Andrew Lamb

YouTube video by The ASF

youtu.be

Make TPC-H data scale factor 10 faster than you can type the command (under 10 sec). The new release of tpchgen-cli is out -- try it via uvx uvx tpchgen-cli parquet --scale-factor=10 Huge thanks to @clflushopt.bsky.social and @kevinjqliu.bsky.social

The folks at Nvidia are building GPU query engines with DataFusion as the embeddable frontend: developer.nvidia.com/blog/designi...

Designing GPU-Accelerated Query Engines with NVIDIA GQE | NVIDIA Technical Blog

GPU-accelerated query engines are often constrained by memory and I/O bandwidth. NVIDIA hardware advances—including high bandwidth memory (HBM), NVIDIA NVLink-C2C, and dedicated decompression engines…

developer.nvidia.com

Pretty great to see the DataFusion meetup in China this past weekend: github.com/apache/dataf...

Thanks to @clflushopt.bsky.social and @kevinjqliu.bsky.social I think we are pretty close to having a CLI that can generate TPCDS data as parquet. I am pretty stoked. Follow along: github.com/clflushopt/t...

[Tracking] TPC-DS support · Issue #218 · clflushopt/tpchgen-rs

With #212 merged we currently have the machinery to fully support TPC-DS but it's not yet satisfying, this issue will track some changes and improvements we would like to make before claiming TPC-D...

github.com

If you have ever wondered what features were introduced when in Apache Parquet we have a new page that tells you: parquet.apache.org/docs/file-fo... (trying to bring sanity to the versioning, one at a time)

Call for (20 min) presos on "What cool thing are you building with @ApacheDataFusio ?" github.com/apache/dataf...

Headline Features in Apache DataFusion 54: 1. Performance (now within 10% of ClickBench leaderboard) 2. Lambda Functions 3. Content defined chunking for Parquet 4. New AVRO reader 5. Better / faster joins + spilling datafusion.apache.org/blog/output/...

Apache DataFusion + Golang: github.com/datafusion-c... (thank you Jake)

GitHub - datafusion-contrib/datafusion-go: datafusion-go provides a database/sql driver for the datafusion query engine

datafusion-go provides a database/sql driver for the datafusion query engine - datafusion-contrib/datafusion-go

github.com

Floating point values in Apache Parquet statistics 📰 parquet.apache.org/blog/2026/05...

This is a pretty sweet blog from people at AWS about co-optimizing Apache DataFusion Comet for real workloads: datafusion.apache.org/blog/2026/06...

What two months with the Comet community got our Spark workload on Amazon EKS - Apache DataFusion Blog

datafusion.apache.org

Whenever I think we can't possibly make filtering faster in Arrow / Rust, I am proved incorrect. Huge kudos to @ClSlaid for squeezing out even more performance github.com/apache/arrow...

We recently hit 5 digit issue mark in arrow-rs. Admittedly this isn't as cool as before LLMs but it is still neat 🤩 github.com/apache/arrow...

A new milestone: @duckdb.org is following DataFusion 😎 github.com/duckdb/duckd... Admittedly this is somewhat ClickBenchmaxxing, but I think it is evidence that analytic engine performance is converging over time (we are in a race to the bottom on performance), accelerated by LLMs

Parquet just finalized a years long effort to standardize everyone's favorite topic: ordering of FloatingPoints and Nan statistics. It takes a while but the spec does evolve github.com/apache/parqu...

PARQUET-2249: Introduce IEEE 754 total order & NaN-counts by JFinis · Pull Request #514 · apache/parquet-format

This commit is a combination of the following PRs: Introduce IEEE 754 total order PARQUET-2249: Introduce IEEE 754 total order #221 Add nan_count to handle NaNs in statistics PARQUET-2249: Add nan...

github.com

I just had the chance to watch @samyak.me 's talk about cancellation safety and async Rust (and how a `&mut` can lead to a deadlock). If this is a topic that interests you, I recommend checking it out: samyak.me/talks/cancel/

July 22 in Denver, CO Apache DataFusion meetup: Join myself, Andy Grove, Brent Gardner to find out about DataFusion, meet other users, and talk about Databases. We still have speaking slots left (10-15 minutes) and would love to have you join us luma.com/jsu6faie

Denver Apache DataFusion Meetup · Luma

Join us for an evening of talks, panel discussion, and community discussion about Apache DataFusion and its growing role in modern data infrastructure. We will…

luma.com

Apache DataFusion physical meetups are fundamentally discriminatory for certain groups based on location, but we try hard to always post the technical content. Here is a link to the recordings and slides from our May 14 2026 meeting in NYC: github.com/apache/dataf...

DISCUSSION: Apache DataFusion New York Meetup May 2026 · apache datafusion · Discussion #20030

Last NYC meetup (#10343) was a great success, I think ~6 months later is a great time to do another one! @gene-bordegaray and I will be organizing, we'll host at DataDog again. This meetup is sched...

github.com

Waynexia and Xudong369 and others are planning a @ApacheDataFusio meetup in China in June 2026. Let them know if you are interested in attending: github.com/apache/dataf...

DISCUSSION: DataFusion Meetup in Asia and China 2026 · apache datafusion · Discussion #16334

Hey all, This discussion is to initiate the event organization. Please feel free to share ideas - we'd love to see who's willing to participate or take the stage (event details below). Time: TBD (m...

github.com