Honored that our paper won the 2025 IEEE TPDS Best Paper Award! buff.ly/4AiBN0S The main idea is to use differential analysis on dependence graphs to causally determine root causes of performance issues. Credits to Yuyang for the hard work, Jidong for leadership, and to all of our co-authors!

Happy Birthday, Jack J. Dongarra! Dongarra received the #ACMTuringAward in 2021 for his pioneering contributions to numerical algorithms and libraries that have enabled high-performance computational software to keep pace with exponential hardware improvements. youtu.be/Oe9LRKoE6L0?...

A successful week at #ICML26 is nearing its end: Learn about (1) weather model scaling laws from Yuejiang, (2) near-optimal quantization from Jiale, (3) sparse data scaling laws from Boqian, (4) a cool algorithm for sparse training from Qiao, and (5) process reward agents from Jiwoong, Tomasz et al

The actual #AI and #HPC accelerators are the building blocks: various precision matrix and vector units and high-bandwidth memory will define the future of accelerated computation much more than #GPUs vs. #CPUs. Also opening the door for highly-efficient software-defined dataflow.

Three HPC Gurus Ask: Do We Still Need GPUs?

Yes, that simple question is, in the modern Nvidia world that has come to dominate AI training and t ...

buff.ly

It was great attending the 75th Lindau Nobel Laureate Meeting last week. I'm very much looking forward to deliver the Heidelberg Plenary Lecture in #AI next year at the 76th! Congratulations to both Peter and Nikolaus for receiving those special honors.

ADIA Lab in Abu Dhabi is looking for a Senior Computational Scientist in Trustworthy #AI to lead a world-class research program. If you have a PhD, 5+ years of experience, and a strong publication record in top-tier venues like #NeurIPS and #ICML, then go and check it out! Apply:

ADIA Lab - Senior Computational Scientist - Trustworthy AI - Abu Dhabi Investment Authority

ADIA Lab, an independent research institution based in Abu Dhabi specializing in data science, artificial intelligence, and computational sciences, is seeking a Senior Computational Scientist with a…

buff.ly

Big congrats to our Racklette team for the 1st prize in the #ISC26 student cluster competition. Switzerland is back, very proud of this repeated success!! Thanks to Hussein and CSCS for the strong support. Look at that big golden trophy for the future leaders in #AI and #HPC!

Saverio presents the #ISC26 Hans Meuer award paper. Selecting and tuning collective operations is not simple. Need to consider various systems effects, for example, load on global vs. local links and different phases. Also using ATLAHS #HPC for selection isc-hpc.com/isc-high-per...

This year's Jack Dongarra award goes to Devesh Tiwari. He starts his talk with an hommage to Jack and then lures the audience into quantum computing. Well done 😀.

Kudos to ETH Zurich's team RACKlette competing at the #ISC26 conference. Next generation #HPC and #AI experts are competing at one of the most prestigious international venues. Learn about the team at buff.ly/ZFBJRSh Wish them all luck!! Fight hard to win!

Surprise: Chinese LineShine supercomputer takes the #1 spot on the #Top500 and #HPCG lists! First time since a while that spot is taken by a homogeneous CPU machine. So is heterogeneity here to stay? CPUs with HBM and tensor cores (e.g., ARM SME). Congrats Yutong and folks.

Martin Schulz from TUM says "heterogeneity is here to stay" and highlights several approaches like quantum, neuromorphic, and ofc. GPUs. Quantum and all of those are #HPC and that's what we're here for at #ISC26! Great opening. We may see a surprise here in an hour 😉.

As #ISC26 is coming up, I wrote down thoughts on the central metric in our #HPC and #AI community: flop/s. A flop is a count; flop/s is a rate. FLOPS is yelling, flops is confusing, and “TFLOPS” is how unit symbols go to therapy. HPC deserves better. buff.ly/LpWDYBU Enjoy & see you in Hamburg!

At #AI4X, Michele Ceriotti questions inductive biases even in material sciences, calling "Let them learn". An interesting hypothesis also in other sciences. I will give an overview of AI for Science in Climate Sciences, one of the hardest to validate. Join us tomorrow 9am! #AI and #HPC

Arrived at #AI4X in Singapore for Chorh Chuan Tan's opening remarks setting the stage for AI for Science as an accelerator. "Nations not using AI in Science will likely fall behind". SG will "converge science" with computation and AI through autonomous labs. What a time to be in #HPC and #AI

News from Jensen Huang @ Build: "Microsoft deployed the largest number of Grace Blackwells in the world today." Kudos to the team for the elegant network with MRC, a step towards UE - enabling very large, cost-effective, and resilient deployments. buff.ly/7WtYXiL buff.ly/rZGTEqm [29:45ff]

The SciFM conversation is shifting from models to systems. The interesting questions this year were increasingly about how to connect agents, instruments, data, simulations, and compute into effective discovery ecosystems. cs.uchicago.edu/news/scifm-2... @ramanathanlab.bsky.social

SciFM 2026 at UChicago: Inside the Premier Gathering of AI, Foundation Models, and the Future of Scientific Discovery - Department of Computer Science

Walking onto the University of Chicago campus this May, visitors to SciFM 2026 could sense the electric anticipation. As the third installment of the Scientific Foundation Models conference series unf...

cs.uchicago.edu

Big announcements on MS Build 💪: Maia 200 now online in Iowa and Arizona, going international soon - at 30% better TCO than best GPUs! Big success for our SDLA architecture. 🚀 Running GPT-5.5/copilot and MAI's thinking model achieves 1.4x perf/W vs. GB200! 👏 buff.ly/WuGgZm4 (22:40 and 1:55:17)

After a nice early morning run, #SciFM26 in Chicago continues. Rafael shows how many physics models actually learn the same representations in their latent space if you compare proximity of embeddings. Next: my panel on the disappointment of physical biases and priors in climate foundation models.

Just arrived at SciFM in Chigago. First thing I hear from the panel is great: "Agents are the new programming. They form their own language and system stack. And we computer scientists should contribute the algorithms." 💯, we also need to develop the best architectures! #HPC

Mateo Valero discusses history of vector architectures: Back to the Future in #HPC and #AI. He also mentions the three quantum computers connected to an NVIDIA Blackwell system in BSC's chapel ⛪️. Ending his talk looking for a future site 😀.

Taisuke Boku follows on another interesting note: Japan is "changing lanes" from CPU to GPU and from "Made in Japan" to a collaborative "Made with Japan", partnering Fujitsu with NVIDIA. "We don't chase fp64 performance but focus on #AI flops". Onward!

Yutong Lu reveals the LineShine exascale architecture for #HPC - #AI convergence: 2 exaflop sustained fp64 at 40 MW with 1.34 million ARM CPUs using SME and 4TB/s HBM connected with 800G. From "offline to online acceleration with SME".

Jack Dongarra's opening keynote at HACI 2026! #HPC in transition - the investments in compute infrastructure are unprecedented but focus mostly on #AI workloads. Scientific numerical simulations need to adjust! Many interesting challenges ahead.

Read how we designed and deployed Multipath Reliable Connection (MRC), a multi-company step towards Ultra Ethernet, at 800G in Microsoft's datacenters. Demonstrated with a 75k GPU pretraining job running stably through multiple faults. OpenAI blog: buff.ly/X0KL4Xy Paper: buff.ly/I3OcXWn

Supercomputer networking to accelerate large scale AI training

OpenAI introduces MRC (Multipath Reliable Connection), a new supercomputer networking protocol released via OCP to improve resilience and performance in large-scale AI training clusters.

buff.ly

The future is here on my way back from Salishan. My air office is a bit narrow but with both faster Internet than at home and a better view. Very well done Starlink and United! Now, Swiss and Lufthansa - time to catch up :-).

Are you also frantically working on your submission to Supercomputing #SC26? Make sure to follow the scientific benchmarking guidelines to ensure interpretability and good style. Don't miss any of the 12 rules for #HPC and #AI systems benchmarking. buff.ly/Ibqwe4N

We are happy to welcome Jianyang Gao, a new Postdoc at #SPCL and look forward to our collaboration!🚀 #HPC @thoefler.bsky.social @csateth.bsky.social

Join us at ADIA Lab's Summer School on Responsible #AI in Granada. A unique opportunity to learn, network, and form connections for life. Apply by March 17! buff.ly/vJkn5ao buff.ly/lfj3NDo

ADIA Lab Summer School 2024: "Trustworthy, safe, and governable AI”, University of Granada, Spain

youtube.com

Was nice attending Koc University's #AI Symposium this week - thanks for having me! Lots of opportunity to connect and meet old and new friends while catching up with Didem Unat and her group on emerging #HPC and #AI systems research. buff.ly/szKlUPR