10 months later, we're hiring for a reliability focused engineer :) jobs.ashbyhq.com/modal/84467a... If you know someone great that'd want to be a founding reliability eng for Modal's GPU-focused cloud platform, lmk!

Member of Technical Staff - Reliability Engineering

Member of Technical Staff - Reliability Engineering

jobs.ashbyhq.com

Jonathon Belotti@jonathonbelotti.bsky.social · last yr.

Is there a SRE book but for startups? Google’s book is great but it doesn’t contend with the tradeoffs and constraints of a young growing startup.

When I was at Canva I had to get a batch job to run demographics analysis vision models on over 90 million images. It took a couple weeks, but felt like with the right infra it could be done in a couple hours. The infra now exists :)

Introducing Modal Batch: Process 1 Million Jobs with 1 Line of Code

Modal Batch is a new interface backed by a new durable queue system built specifically to make job processing easy, scalable, and fault-tolerant.

modal.com

Hypervisor as a Library #rustlang seiya.me/blog/hypervi...

Hypervisor as a Library

seiya.me

We won't tell you where the deep and cheap GPU capacity is, but we will teach you how to fish.

Linear Programming for Fun and Profit

How we use an eighty-year-old algorithm to find arbitrages in the cloud market.

modal.com

Is The Soul of a New Machine the best book about the computer industry because Kidder is.. - an outsider - a full-time writer - simply a first rate writer Other industries have had ‘homegrown’ Pulitzers—medicine, law, finance, bilogy—but not computing.

LLMs have shifted my blog post drafting back to my static-site repository away from Notion. I can play with HTML and JS so easily during iteration with Cursor. Markdown+Blocks is hamstringing.

Is there a SRE book but for startups? Google’s book is great but it doesn’t contend with the tradeoffs and constraints of a young growing startup.

History-posting once again: thundergolfer.com/blog/the-fir...

My brilliant @modal-labs.bsky.social colleague Charles won't stop until we're all pushing our GPUs to their limits: modal.com/blog/gpu-uti...

'I paid for the whole GPU, I am going to use the whole GPU': A high-level guide to GPU utilization

A guide to maximizing the utilization of GPUs, from cloud allocations to FLOP/s.

modal.com

The Tom Brady of Youtube educational content is at it again. One of those rare lectures which deserves to be called enlightening. I hope @karpathy.bsky.social is steering clear of helicopters, submersibles, and smoking. We need him.

Deep Dive into LLMs like ChatGPT

YouTube video by Andrej Karpathy

youtube.com

At @modal-labs.bsky.social your customer questions sometimes get a whole blog post :) Why does an NVIDIA H100 SXM 80GB card offer 85.52 GB? thundergolfer.com/blog/nvidia-...

Found out you get 220MiB more H100 HBM3e VRAM on Oracle Cloud compared to GCP. GCP's instances have more `reserved` memory and I can't figure out if this is configurable from the guest.

Wrote about how a warmed up container can be saved to disk and later restored for a 2.5x cold start performance boost. Saving live container processes to disk turns out to be pretty whacky and interesting! modal.com/blog/mem-sna...

Memory Snapshots: Checkpoint/Restore for Sub-second Startup

Serializing container state to disk for aggressive cold start optimization.

modal.com

This contains the shortest and clearest explanation of S3’s $0.02/gib/month cloud economics that I’ve seen, and lots more good stuff. tailscale.com/blog/living-...

Living in the future, by the numbers

Instead of making the traditional New Year predictions, let’s talk instead about the beautiful technological future we live in: the one that exists right now but we don’t always notice.

tailscale.com

Quick post about those 'latency numbers every programmer must know'. It became mostly an affirmation of @sirupsen.bsky.social 's napkin-math repo (bookmark it).

New goal in 2025 is to write one software essay with the zany energy of an All Souls College essay prompt: Does the moral character of an orgy change when the participants wear Nazi uniforms? thundergolfer.com/all-souls-so...

GPUs can be understood: modal.com/gpu-glossary...

README | GPU Glossary

modal.com