Pete Hodgson

@thepete.net

Outside expert helping engineering teams adopt AI

This new benchmark is an apt metaphor for the AIs ability to gaslight humans with legit-looking-but-wrong output. Oh, you can't find the raccoon? Huh. Sorry you're having trouble with that, meatsack. I tried to not make it TOO hard for you, lil bud, but I'll make it even easier next time.

Simon Willison@simonwillison.net · 4mo ago

I came up with a somewhat foolish new benchmark for testing image generation models, to exercise the new ChatGPT Images 2.0: "Do a where's Waldo style image but it's where is the raccoon holding a ham radio" simonwillison.net/2026/Apr/21/...

Reminder for whoever needs to hear it, today's cutting edge AI models are still very jagged in their "PhD-level intelligence". Put more bluntly, Opus 4.6 Extended sometimes can't count to 2. 🫠

transcript from a Claude.ai session with Opus 4.6 Extended which includes:

"push the [training run] from Tuesday to Thursday. That gives your lungs 3 more days."

It's hard to find balanced opinions on AI coding. Lots of the people pushing the envelope on AI-Assisted Engineering also have somewhat bonkers AI-maximalist perspectives. Here's some people who're in the thick of it, advancing the field but who I also trust to bring a thoughtful, balanced take 🧵

Hot-ish take: devs should be spending time now learning out how to be *efficient* with the tokens in their agent's context windows 1) it makes the agent perform better 2) tokens are gonna start costing more over the next couple of years These Ralph shenanigans might look real silly in retrospect

“Have you tried out Ralph Wiggum loop?!” “Are you still using beads?” “Is Gas Town actually legit?” “Know anyone who’s into BMAD?” These days I’m glad my family doesn’t know what my Serious Work Conversations sound like. It’s embarrassing. Let’s talk about how to deal with all this noise. 🧵...

Claude Code is an amazing product. It does amazing things. I love it. Amazing. It's also most typically used as a CLI tool. This does not mean that Claude Code is an amazing product BECAUSE it's a CLI. Tell me why I'm wrong!

Gonna start saying "Clod" when referring to Claude Code. I've felt a need to use its full name to disambiguate between the Claude Code - the coding agent - vs Claude - the general purpose chat bot, but it's so tedious to type it out in full. It's either CC or Clod, and Clod is more fun.

"Why is Claude Code better/worse than [other coding agent] - they’re both using the same models under the hood?" A reasonable question, so I spent some time reverse-engineering Claude Code's interactions with the model to illustrate why coding agent matters blog.thepete.net/blog/2025/12... 🧵...

Same Model, Different Results: Why Coding Agents Aren't Interchangeable

Reverse-engineering Claude Code reveals why it performs differently from other agents that use the same Anthropic models. The answer lies in sophisticated context engineering and tool orchestration hi...

blog.thepete.net

I continue to believe that context management is the #1 skill to develop if you want to get the most out of coding agents. But why? Modern models have a context limit of 200,000 tokens! That seems like a lot! There's a couple of reasons why... 🧵

AI WON'T turn you into a 10x engineer but it CAN accelerate your day-to-day work. I'm hosting a live workshop early next month to help experienced devs level up from copilot to coding agents. No breathless hype, no "learn this one magical prompt" BS, I promise! blog.thepete.net/ai-assisted-...

AI-assisted Engineering Workshop Series

Level up from copilot to coding agents in this practical online workshop teaching AI-assisted Engineering practices for experienced developers. No breathless claims about 10x productivity. No suggesti...

blog.thepete.net

Blurghed about managing you AI coding agent's context. Proactively trimming and refining the context your agent is working with is probably THE best way to improve the quality of it's work. But there's more to it than firing off a `/compact` every now and then. blog.thepete.net/blog/2025/10...

AI Coding: Managing Context

Managing your coding agent's context is super important - a bloated context window will erode the quality of your agent's work over time. Learn some new techniques for trimming irrelevant details from...

blog.thepete.net

Good example of why it's important to monitor your LLM-powered features in prod. Apparently some bug in Amazon's AI assistant where the product description isn't in it's prompt. Pre-production evals are super important, but wouldn't catch this. Monitoring some key metrics in prod would.

Bild