Tessera
Folgen

Dewey Dunnington

@paleolimbot.bsky.social

Scaling spatial computing at Wherobots, Inc. ApacheArrow PMC, #gischat, #rstats, ex Voltron Data.

89 Posts257 Follower95 Folgt
Dewey Dunnington@paleolimbot.bsky.social · last mo.

We're excited to announce a new release of SedonaDB, and this one is a big one! Between native DataFrame APIs in Python and R, a brand new Geography implementation, GPU accelerated joins, and a raster/ND-array foundation, it's hard to know where to start.

Bild
Hadley Wickham@hadley.nz · 2mo ago

dbplyr 2.6.0 is here! This release leaned on Claude Code to clear a TON of smaller issues, freeing up time for the big stuff: brand-new ADBC and JDBC backends, new translations, and a new sql_dialect() to cleanly decouple connection from SQL dialect. Read more: opensource.posit.co/blog/2026-06...

dbplyr 2.6.0

dbplyr 2.6.0 is now on CRAN, with new ADBC and JDBC backends, IBM DB2 support, more translations, and a bunch of minor fixes and improvements.

opensource.posit.co

Mara Averick@dataandme.bsky.social · 2mo ago

I'm alive *AND* I wrote a blog post?! Unheard of! Much 💖 to @abbycabs.dev, and @grafana.bsky.social's David Allen and Amanda Wagner whose FOSDEM talk's were a huge source of inspo!

stdlib@stdlib.io · 2mo ago

For years, open source communities relied on visible friction: people got stuck, asked questions in public, and became part of a community. AI is changing that. What happens when newcomers are no longer visible—and neither side knows the other is there? blog.stdlib.io/ai-and-the-i...

Lawrence Vulis@lvulis.bsky.social · 3mo ago

Modern geospatial SQL means you can skip the parallelization etc that we try to do to actually get these types of runs to complete.

Dewey Dunnington@paleolimbot.bsky.social · 3mo ago

In 2024 I spent days trying to optimize a point-in-polygon join with ~130 million points against all U.S. zipcodes and the best I could come up with was a few minutes. In 2026, both SedonaDB and @duckdb.org spatial can both do it in seconds 🤯. More in the post! dewey.dunnington.ca/post/2026/wr...

Dewey Dunnington@paleolimbot.bsky.social · 4mo ago

Can your current spatial SQL engine ST_💩()? We didn't think so! As part of our ongoing attempt to innovate on spatial SQL in Apache Sedona, this we're proposing emoji shorthands for most functions which (1) improve expressiveness and (2) helps more SQL fit on one line.

Bild
Kyle Walker@kylewalker.bsky.social · 5mo ago

I tend to be a CRAN-appreciator. But wow, R-Universe is such a useful project. As a developer, I can: - Experiment with new and creative approaches that would never get accepted on CRAN; - Have cross-platform binaries for my packages built within an hour (usually) of a GitHub push

Columnar@columnar.tech · 5mo ago

The fastest operation is the one you don’t have to do. When a database natively supports @arrow.apache.org, ADBC can speed up fetching and ingestion by eliminating costly row/column conversions. How much faster is it in practice? We ran some benchmarks to find out. Link below 👇

An abstract hyperspace warp image inspired by the comedic "going plaid" effect from the 1980s cult film "Spaceballs".
Dewey Dunnington@paleolimbot.bsky.social · 5mo ago

We're chuffed to announce Apache SedonaDB 0.3.0! This release features a rewritten join that supports larger-than-memory spatial/KNN joins courtesy of Kristin Cowalcijk, new functions, parameterized SQL queries, GDAL/pyogrio reads, GDAL/sf based reads in R, and the beginnings of an R DataFrame API!

Bild
Anita Graser 🇪🇺🇺🇦🇬🇪@underdarkgis.fosstodon.org.ap.brid.gy · 8mo ago

Wohoo, QGIS Arrow support has been merged: https://github.com/qgis/QGIS/pull/63749 Thanks @paleolimbot & @nyalld et al. Looking forward to testing it out soon 🤩 #QGIS #Arrow #GISChat

Implement QgsArrowIterator to iterate over features as batches of ArrowArray by paleolimbot · Pull Request #63749 · qgis/QGIS

Description As encouraged by @nyalldawson! https://mastodon.social/@nyalld/115459416976982489 The motivation is to eliminate the need for per-feature iteration in Python to maintain the fidelity of...

github.com