A system programmer’s guide to LLM inference, hope you like it! blog.xiangpeng.systems/posts/how-to...

A system programmer’s guide to LLM inference – Xiangpeng’s blog

Let’s build a local LLM inference engine in Rust with no dependencies.

blog.xiangpeng.systems

Simply applying basic linting rules (like don't compress pages where it doesn't help) reduces parquet files sizes by 5% and decreases decode time by 20%. @xiangpeng.systems shows how in his latest blog blog.xiangpeng.systems/posts/parque...

parquet-linter: A better Parquet is Parquet itself – Xiangpeng’s blog

Unleash the performance potential of your Parquet files

blog.xiangpeng.systems

Stop building systems for agents, build systems for human. We need infrastructures to help us holding accountability of agent's code. blog.xiangpeng.systems/posts/stop-b...

Stop building systems for agents – Xiangpeng’s blog

Build agent systems for human.

blog.xiangpeng.systems

After two years since publication, Bf-Tree is finally open-sourced github.com/microsoft/bf... The GitHub repo just hit the Hacker News front page 🎉🎉🎉

GitHub - microsoft/bf-tree: Bf-Tree is a modern read-write-optimized concurrent larger-than-memory range index in Rust from MS Research.

Bf-Tree is a modern read-write-optimized concurrent larger-than-memory range index in Rust from MS Research. - microsoft/bf-tree

github.com

Mitchell is the creator of the github.com/mosure/bevy_... render-pipeline plugin for Bevy, and he’ll dive into real-time radiance-field rendering, GPU data layouts, kernels, profiling, and more.

GitHub - mosure/bevy_gaussian_splatting: bevy gaussian splatting render pipeline plugin

bevy gaussian splatting render pipeline plugin. Contribute to mosure/bevy_gaussian_splatting development by creating an account on GitHub.

github.com

Tyler Hillery@tylerhillery.com · 8mo ago

Our first Madison Systems talk is scheduled! Mitchell Mosure is presenting on Bevy Gaussian Splatting. Register Here: luma.com/u7p9tvsz

Nice to see this getting shared! 🙌 Now I’m even more motivated to turn it into a full course.

Xuanwo@xuanwo.io · 9mo ago

For everyone interested in data infra, want to get a quick sense of how big data works, how data systems are designed, and what the tradeoffs are, start with this share from @xiangpeng.systems, really nice intro! intro-data-system.xiangpeng.systems

Just like other big cities, Madison is getting its own systems talk series. Come join us!

Tyler Hillery@tylerhillery.com · 10mo ago

@abigalekim.bsky.social @xiangpeng.systems and I are kicking off Madison Systems with a coffee chat on Sunday, Nov 9th. Come nerd out on systems! luma.com/v69tvpla

LiquidCache a distributed pushdown cache for DataFusion, designed to cut down S3 requests for diskless databases. 💻 Code: github.com/XiangpengHao... 📄 Paper (VLDB 2026): github.com/XiangpengHao...

Andrew Lamb@andrewlamb1111.bsky.social · 11mo ago

What is LiquidCache in these slides: what-is-liquid-cache.xiangpeng.systems BTW @xiangpeng.systems is looking for some early adopters who want to be on the bleeding edge. Hit me up if interested

Join my PhD prelim talk next Monday: Data-Aware Caching for Cloud Analytics 🕐 May 19, 1PM CDT 📍 CS2310 or Zoom: uwmadison.zoom.us/j/3081128886

My manifesto on optimizing SQL and DataFrames in query engines (including an explanation of why Apache DataFusion doesn't have a complex join ordering algorithm): www.influxdata.com/blog/optimiz... www.influxdata.com/blog/optimiz...

Optimizing SQL (and DataFrames) in DataFusion: Part 1

This post reviews what a Query Optimizer is, what it does, and why you need one for SQL and DataFrames. It also describes how industrial Query Optimizers are structured and standard optimization class...

influxdata.com

New blog post: "Build your own S3-Select in 400 lines of Rust" Check it out 😉: blog.xiangpeng.systems/posts/build-...

Build your own S3-Select in 400 lines of Rust – Xiangpeng’s blog

DataFusion is ALL YOU NEED

blog.xiangpeng.systems

I submitted a PR that cuts average ClickBench latency by 15% for DataFusion! But reviewing it wasn't straightforward due to the nature of complex performance tuning dynamics, so I made a blog post to explain why it works -- check it out: blog.xiangpeng.systems/posts/parque...

Efficient Filter Pushdown in Parquet – Xiangpeng’s blog

How to implement efficient filter pushdown in Parquet readers and why it’s challenging in practice.

blog.xiangpeng.systems

We are excited to share Fray Debugger (aoli.al/blogs/deadlo...), an IntelliJ plugin that allows you to control concurrent execution deterministically! We have translated the Deadlock Empire (deadlockempire.github.io) into Java to demonstrate how to use Fray Debugger.

@xiangpeng.systems shared a great post about system researchers. I wrote a comment on it and would like to share some thoughts here and offer complementary ideas. In short: build paper with open source. xuanwo.io/links/2025/0...

Wrote a blog post reflecting my thoughts on DeepSeek, NSF funding and system research communities in general. Apologies for the bold claims -- hope they can invite some discussions. blog.xiangpeng.systems/posts/system...

Where are we now, system researchers? – Xiangpeng’s blog

blog.xiangpeng.systems

Checkout the underneath framework: github.com/cmu-pasta/fray Looking forward to a future Rust support😉

GitHub - cmu-pasta/fray: A controlled concurrency testing framework for the JVM

A controlled concurrency testing framework for the JVM - cmu-pasta/fray

github.com

Phil Eaton@eatonphil.bsky.social · last yr.

Oh hell yeah, a blog from Elasticsearch about bugs and concurrency control in Lucene. www.elastic.co/search-labs/...

My weekend project now comes with AI super power! Now you can explore Parquet data with natural language! parquet-viewer.haoxp.xyz

This is amazing -- an open source query engine build on open standard is now the fastest, and it is in Rust! datafusion.apache.org/blog/2024/11...

New blog post on the fun new hardware advancements which databases can leverage for great gains, and why the cloud means it doesn't matter that they exist. 🫠 transactional.blog/b...

My shoddy ASCII art about writing data to disk was surprisingly popular, so I finished off an old set of notes talking more comprehensively about durably writing data to disk and added a better version of the diagram. transactional.blog/h...

Checkout my weekend project on Parquet explorer: xiangpenghao.github.io/parquet-expl... It compiles Rust Parquet into WebAssembly, allowing you to explore the structure of Parquet files directly in your browser!

New blog post on caching in DataFusion! See how my research is advancing DataFusion’s capabilities and what’s next: blog.haoxp.xyz/posts/cachin...

DataFusion implements one of the most advanced Parquet readers🚀, checkout how: blog.haoxp.xyz/posts/parque...