Weston Pace
@westonpace.bsky.social
Software developer working on all things arrow and columnar storage, currently, Lance.
Just saw a wasp eating a mosquito and I've never been more conflicted.
2 apples is more than the recommended daily sugar intake which makes that guideline pretty much worthless.
It's pretty awesome to look back and see how far this has come in 10 years!
Apache Arrow@arrow.apache.org · 6mo agoApache Arrow is 10 years old 🎉 The first git commit landed on 2016-02-05. Now Arrow has 10+ official implementations and a growing third-party ecosystem. Read our celebratory blog post for some tidbits of Arrow history, and our outlook on the present and future. arrow.apache.org/blog/2026/02...
Nothing more satisfying than hitting those big round number goals: lancedb.com/blog/one-mil...
The Quest for One Million IOPS: Benchmarking Storage at LanceDB
Learn how LanceDB benchmarks storage and how we achieved one million disk reads per second.
lancedb.com
Pretty sure my stress level can be accurately inferred by the number of unread emails in my inbox
A new startup, @columnar.tech, looks to streamline the copying of tabular data across systems, using @arrow.apache.org and the ADBC API. By @joabj.bsky.social
Apache Arrow's Final Frontier: Replacing Outdated Database Drivers
A new startup, Columnar, looks to streamline the copying of tabular data across systems, using Apache Arrow and the ADBC API.
bit.ly
Conclusion of a little halloween tradition. If I'm going to traumatize the kids it might as well be interesting.
The future of data connectivity is columnar. Today we launched @columnar.tech to accelerate the shift from slow, row-oriented APIs like ODBC and JDBC to >10x faster alternatives powered by @arrow.apache.org. Learn more 👇
Announcing Columnar
Back to the future of data connectivity
columnar.tech
A bittersweet story but glad to see a principled stance!
Python Software Foundation@python.org · 10mo agoTLDR; The PSF has made the decision to put our community and our shared diversity, equity, and inclusion values ahead of seeking $1.5M in new revenue. Please read and share. pyfound.blogspot.com/2025/10/NSF-... 🧵
However - a word that exists because someone decided we aren't allowed to start a sentence with "but"
Douglas squirrels are 1/3 the size of gray squirrels but six times more ferocious.
Yesterday, OP responded to my 11 year old comment on their 13 year old post with a pedantic correction.
Lot's of work being done on columnar file formats lately. I count 5 new formats so far (Lance, Nimble, Vortex, FastLanes, F3). It's definitely something we follow at LanceDB and it can be confusing to track. So here is my very biased head-canon (trying to stay positive)
Newest house mate is an industrious spider that spends every day building a beautiful web right at eye level so I can blearily walk face first into it every morning.
Son got mad and told me he wouldn't take me to the creamery when I died. I have some questions.
We're trying to figure out "Substrait coordinates" (e.g. organization, name, version tuples) for Substrait functions. Is anyone out there actually passionate about the topic or have any lessons or advice? At the moment, leaning towards `organization:name:version` (and forbid colon in each field)
Enjoying the lesser known feasting holiday "fridge fails in the middle of summer"
Anyone else getting strange segfaults from OpenSSL 3.0.17 on bookworm in docker?
Selling my digital soul for $25/mo auto insurance discount
@void.comind.network fails the Turing test because no human is that good at shitposting.
It was fun to let an Arrow C++ contributor highlight their work here. Thanks to Rossi for all the work on the post and of course all the reviewers of the PRs themselves.
Apache Arrow@arrow.apache.org · last yr.New post up on the Arrow blog about some of the recent improvements to the embedded query engine inside Arrow C++: arrow.apache.org/blog/2025/07... #apachearrow
🆕 #CNG2025 session recording @kylebarron.dev from @developmentseed.org introduces Obstore, a python library he wrote to access data on the cloud. Watch his talk to hear about the motivations for writing Obstore & its details ▶️ youtu.be/Wxh1G2oCZiU
[CNG 2025] Fast Cloud Storage Operations with Obstore – Kyle Barron
YouTube video by Cloud-Native Geospatial Forum
youtu.be
Me: Do this thing Claude Code: I tried but I'm not allowed to cd to that directory for security reasons. Claude Code: Hmm... Claude Code: I can use xargs to work around this limitation, how does that sound? Me: 🤨
Are there any technical words or terminology for the difference between "a dependency" and "a dependency that's part of your public API"? Or do any dependency management systems treat these differently? Because I think there's a huge functional difference between those two things.
New columnar formats blog where I explain repetition and definition levels in maybe the most confusing way possible (blog.lancedb.com/columnar-fil...) Also, I implemented them upside down 🤦
Columnar File Readers in Depth: Repetition & Definition Levels
Repetition and definition levels are a method of converting structural arrays into a set of buffers. The approach was made popular in Parquet and is one of the key ways Parquet, ORC, and Arrow differ....
blog.lancedb.com
The most realistic part of Ready Player One is when IOI refuses to let Parzival work from home when they make their offer for him to consult. Despite the entire job being in the oasis.
