john44234.bsky.social

@john44234.bsky.social

Many don't see how much AI has changed recently. Coding agents aren't just chatbots. We can’t deal with the challenges of AI if we don’t understand it. Here's a post to provide some evidence (Claude doing small ML experiments) and form intuitions. davidpreichert.substack.com/p/if-you-hav... 🧵..

If you haven’t recently used Claude Code*, you might not understand where AI is at

A report on a series of mini machine learning projects, executed with, and mostly by, Claude

davidpreichert.substack.com

Your infrequent reminder that if you live near the San Francisco Bay Area you should go to Moss Landing (south of Santa Cruz) and rent kayaks there, because the estuary is full of sea otters and you will encounter dozens of them

A sea otter chilling on its back in an estuary, land and trees in the background

I work at Google DeepMind. This won't make me popular. But it's all public reporting: 2014: DeepMind reportedly sold to Google on conditions: no military use, independent oversight 2026: a Pentagon contract for "any lawful government purpose" Not one safeguard survived intact

Collage titled "Trust is not Governance — an essay from inside Google DeepMind, written in personal capacity." 

A 2014 memorandum, "Conditions of the Acquisition," lists: military applications of DeepMind technology banned; deployment decisions before an independent ethics board (as reported in Mallaby's The Infinity Machine). 

Red threads lead to a 2026 U.S. Department of Defense agreement for classified networks reading "any lawful government purpose," with safety settings and filters adjusted at the government's request and no contractor veto (reported terms, The Information, Apr. 2026). 

Below: a 2018 AI Principles strip ("no weapons, no surveillance") stamped DROPPED 2025, and a Project Mario 2016–2021 tag stamped ABANDONED.

Even before the agentic revolution, prompting tricks stopped being very valuable, as our research has shown. The format isn't key, the best approach to AI right now is to clearly specify your goals, your output, what "good" & bad look like, how to test the results... (yes, this is just management)

BildBildBildBild

The most interesting Fable tip I've heard so far is to let the model use its own judgement as much as possible I told it "For all coding tasks use your judgement to decide an appropriate lower power model and run that in a subagent" and it seems to be saving tokens simonwillison.net/2026/Jul/3/j...

Fable's judgement

One of the most interesting tips I got from the Fireside Chat I hosted with Cat Wu and Thariq Shihipar from the Claude Code team at AIE on Wednesday was …

simonwillison.net

It is a good time for moonshots. AI has reached a level where there are transformative projects that could result in huge social good, but require public R&D, consensus & transparency to pull off. Examples of such projects: universal tutors, co-scientist/replication systems, and remote medical help

Science fiction authors in the order you want them to be right about AI: Iain Banks Becky Chambers Martha Wells Douglas Adams Charles Stross (Singularity Sky) Peter Watts Charles Stross (Laundry) Harlan Ellison

a transformer is a nonrecurrent architecture. think of it like a big Pachinko machine. you put the token embeddings in the top (entangled with positional embeddings which tell you where in the context vector they occur) and a prediction for the next token falls out the softmax layer at the bottom.

I have been charged in a federal indictment sought by the Department of Justice. This political prosecution is an attack on all of our First Amendment rights. I’m not backing down, and we’re going to win.