Vortex is incredibly exciting, we’ve already made plans months ago to make it the primary format we will be storing our data in on object storage! www.linuxfoundation.org/press/lf-ai-...

LF AI & Data Foundation Hosts Vortex Project to Power High Performance Data Access for AI and Analytics

Contributed by SpiralDB, Vortex is an extensible, next-generation columnar storage format designed for building high-performance, future-proof data systems

linuxfoundation.org

docs.rs/fsst-rs/late... in the wild 🎉

Andrew Duffy@a10y.dev · last yr.

That feeling when you're browsing some random project and it's using your code 🥹 github.com/asayers/jetr...

We managed to accelerate the entire TPC-H (sf=100) suite by 30%, with many of the slowest queries seeing a 2-4x speedup. Check out the post for the inside scoop 🧊

Andrew Duffy@a10y.dev · last yr.

Last month I worked on Apache Iceberg integration for Vortex, the results of which we presented earlier this month at Iceberg Summit. I wrote a post about my experience bridging our Rust-based system to Iceberg and Spark spiraldb.com/post/vortex-...

"So you want to use Object Storage" By @adamgs.bsky.social spiraldb.com/post/so-you-...

So you want to use Object Storage

Tips and lessons learned from building systems directly against object stores

spiraldb.com

If you're at #IcebergSummit, be sure to come see our CEO and Founder @will-manning.bsky.social present on Turbocharging Apache Iceberg scans with Vortex!

Turns out, all researchers should use rust for their reference implementations. blog.spiraldb.com/alp-rust-is-...

ALP Rust is faster than C++

How well-defined casting semantics in Rust allow for 20-50% faster ALP compression

blog.spiraldb.com

We're starting a London Systems meetup, to give a chance for (software) engineers to share and discuss their work on the underlying systems and that power most of our world - databases, compilers, VMs etc. and we're looking for speakers! lu.ma/londonsystems

London Systems · Events Calendar

View and subscribe to events from London Systems on Luma. A meetup focus on systems-oriented software engineering topics, from experts to anyone. Focused on systems like compilers, databases, browsers...

lu.ma

🌪️📲

Andrew Duffy@a10y.dev · 2y ago

*me, embedding @spiraldb.com Vortex files inside the browser and using the most basic tailwinds* 🦋 👐 “Is this full stack development?”

It's still early days, but initial results suggest DataFusion (Vortex, partitioned) knocks ~15% off the total runtime of DataFusion (Parquet, partitioned) 🚀

Nicholas Gates@ngates.bsky.social · 2y ago

This is awesome work! It’s got us curious how much faster we can push ClickBench with DataFusion on Vortex files 🧐 Will report back…

Greetings fellow data folks! 🦋