Julien Le Dem

@julien.ledem.net

Principal Engineer, Founder, Angel, Advisor, OSS. LFAI&data: OpenLineage, Marquez, ASF: Parquet, Arrow, Iceberg, 🐖 he/him. Me: https://julien.ledem.net/ Blog: https://sympathetic.ink

Last year, I gave a keynote at AI Council about The Deconstructed Database: a composable and extensible database design enabled by the cloud and a collection of standard open source formats and components. (Parquet, Arrow, Substrait, Iceberg, OpenLineage, Calcite, DataFusion).

In the past few years, we’ve seen a cambrian explosion of new columnar formats, challenging the hegemony of Parquet. Presumably, the design of yore is not going to cut it moving forward. I spent some time to understand a bit better how things actually changed. sympathetic.ink/2025/12/11/C...

Column Storage for the AI Era

In the past few years, we’ve seen a cambrian explosion of new columnar formats, challenging the hegemony of Parquet: Lance, Fastlanes, Nimble, Vortex, AnyBlox, F3 (File Format for the Future). The thi...

sympathetic.ink