Daniel ten Wolde

@dtenwolde.bsky.social

PhD student at CWI, Database Architectures | Lead developer DuckPGQ extension | Working on graphs

Whoever summoned this SQL abomination, I can’t tell if I should be impressed or horrified. Now I have to debug it… ChatGPT: it's a recursive SQL simulation of the Fibonacci function, but instead of using simple recursion, it models the function as a concurrent task graph. See: tinyurl.com/yjamy5pm

Bild

🚀 #DuckPGQ is available again for #DuckDB v1.2.2! No major changes this time — 99% of my focus has been on the PhD (which will make its way into the extension eventually) 😄 One new simple pragma: create_vertex_table — does exactly what it says: creates a vertex table based on an edge table.

Only 2.5 weeks until DuckCon #6 in Amsterdam. We have a strong line-up: the presenters will explain how to use DuckDB for tabular, spatial and graph-shaped data, how to solve financial and healthcare use cases, and how to orchestrate and visualize queries. Full program: duckdb.org/events/2025/...

DuckCon #6 in Amsterdam

DuckDB is an in-process SQL database management system focused on analytical query processing. It is designed to be easy to install and easy to use. DuckDB has no external dependencies. DuckDB has bin...

duckdb.org

🎉 DuckPGQ v0.2.1 is here! 🐥 Highlights: - Bug fixes 🛠️ - PRAGMA show_property_graphs ✨ - CREATE PROPERTY GRAPH IF NOT EXISTS 🎯 - From v0.2.0: Create property graphs on attached databases (such as #SQLite) Learn more: duckdb.org/community_ex... Happy holidays! 🎄❄️ I'm off to enjoy the #top2000 🎶

Update DuckPGQ to v0.2.1 by Dtenwolde · Pull Request #238 · duckdb/community-extensions

Changelog Overview Summary of the changes for DuckPGQ v0.2.1 Features Added a grammar rule for creating property graphs with IF NOT EXISTS [4433108]. Added a pragma show_property_graphs to display...

github.com

I just updated the #DuckDB extension visualization site to also include regular DuckDB extensions like Spatial and HTTPFS. Did you know there were nearly 6M extension downloads last week alone? 🚀 Check it out: duckdb-ce-analysis.evidence.app Feedback is always welcome! Made using @evidence.dev

DuckDB extension weekly downloads

Explore dynamic insights into weekly and monthly download trends for DuckDB extensions, all in one interactive dashboard!

duckdb-ce-analysis.evidence.app

🎶 One of my favourite Dutch traditions is the #Top2000! Between Christmas and New Year, the 2000 most-voted songs are played non-stop. 🌟 They even share an Excel sheet with all the songs and their release years. With just three lines of #DuckDB, you can create a histogram of music history! 📊✨

Bild

The closing of DBDBD 2024 was the "Amsterdam Data Systems" session, with talks from @databricks.bsky.social, @motherduck.com and @clickhouse.com (due to illness, @weaviate.bsky.social could not make it). These companies all have a significant presence in Amsterdam. Videos: bit.ly/cwida-ams-da...

60fps of UX Joy with DuckDB+CloudBoaz by Boaz Leskes (DBDBD 2024)

The Dutch-Belgian DataBase Day (DBDBD) is a yearly one-day workshop, organized in a Belgian or Dutch university, whose general topic is database research. DBDBD 2024 will be held at Science Park in Amsterdam, The Netherlands. Website: https://cwida.github.io/dbdbd2024/ In the age of ever more powerful hardware, where your laptop can do more than your typical Datacenter server, MotherDuck leverages DuckDB’s state of the art analytical prowess to drive compute down to your laptop as well as making the most of the Cloud. Combine DuckDB’s versatility to run everywhere (including your browser), augment it with a server-less CDW, and you get (interactive) analytical sessions delivering results in unprecedented speed. So fast it updates your dashboard in 60fps. Biography: Boaz Leskes (MotherDuck Amsterdam) is part of MotherDuck’s founding team and leads its database group. In past life, he spent some years on distributed systems, (Elastic)search and cloud platforms. Will happily talk to any of these, or speed skating, kite surfing, rowing, or any other thing of interest.

bit.ly

Furthermore, we have now posted the videos of these lectures in the Dutch Seminar on Data Systems Design (DSDSD) YouTube channel: bit.ly/cwida-dijkst... many 🙏 to Daniel ten Wolde & Leonardo Kuffo Rivero for editing these!

Dijkstra Fellowship Acceptance Speech by Marcin Zukowski (Dijkstra Award 2024)

Website: https://www.cwi.nl/en/events/dijkstra-awards/cwi-lectures-dijkstra-fellowship/ About the Dijkstra Fellowship The Dijkstra Fellowship is named after former CWI researcher Edsger W. Dijkstra, who was one of the most influential scientists in the history of CWI. Dijkstra developed the shortest path algorithm, among other contributions. The first Dijkstra Fellowships were awarded to David Chaum and Guido van Rossum in 2019. Dijkstra Fellowship 2024 for Marcin Żukowski Marcin Żukowski started his career at CWI. He did his MSc and PhD research on database management system architectures in our Database Architectures (DA) group. As a PhD student under the supervision of Peter Boncz, he developed the innovative concept of vectorized execution to improve the performance of database queries. This research received the DaMoN 2007 Best Paper Award and also the CIDR 2024 Test of Time Award, established by the Conference on Innovative Data Systems Research (CIDR). After his PhD, Żukowski co-founded CWI spin-off VectorWise (now Actian), turning his research into a high performance and highly scalable analytical database system. It became the blueprint for analytical databases, that is still widely used. After yielding a rapid technological and commercial growth, he left the company in 2012 to co-found Snowflake in Silicon Valley. Snowflake offered the first cloud-based data warehousing service that is truly designed for the cloud. Notable features are that it is an ‘elastically’ growing and shrinking system based on how busy it is, separating computation from storage, and automating many administration and configuration tasks. Snowflake uses vectorized query execution and lightweight compression methods in its columnar data storage, two techniques that were co-designed by Żukowski during his PhD years at CWI. Role model After leaving Snowflake earlier this year, Marcin Żukowski stays connected with academia by supervising students, publishing papers and taking part in computer science events. He is also an investor and advisor, supporting technology development and innovation in his home country Poland. “Marcin is an excellent example of how to apply CWI's mission in practice. He used his PhD research at CWI to create versatile foundational software products that are now widely used, and shares his knowledge and experience with the public and in particular with young technology entrepreneurs”, CWI director Ton de Kok says. CWI Lectures combined with Dijkstra Fellowship award Topics of the CWI lectures are related to the architecture of data processing and analysis systems.

bit.ly

#DuckPGQ is now available again for #DuckDB v1.1.3! The major change is that property graphs are now persistent, making it easier to manage graph data across sessions 🎉 (Please don't overwrite the table with the name __duckpgq_internal, I use it for persistence 😬)

It turns out my ‘9,000 connections’ stat was… a little off (thanks to an API quirk that only returned the first 100 followers 🤦). No worries though—I fixed it, scraped more data (still more to come), and cooked up new SQL/PGQ example queries for you! Check them out: github.com/Dtenwolde/bl...

GitHub - Dtenwolde/bluesky-follows-graph: Repo that scrapes the bluesky followers endpoint and runs graph queries with DuckDB and DuckPGQ

Repo that scrapes the bluesky followers endpoint and runs graph queries with DuckDB and DuckPGQ - Dtenwolde/bluesky-follows-graph

github.com