Thomas Steinke

@stein.ke

Researcher in computer science, math, machine learning, (differential) privacy, AI, etc. at Anthropic. Kiwi🇳🇿 in California🇺🇸 http://stein.ke/

My radical suggestion for peer review: Move from nominal pre-publication review to explicit post-publication review. The original reason for peer review was that journal pages are a limited resource, so we need a filter before publication. That no longer makes sense with digital publishing. 1/

Fun fact: You can have two amazon accounts registered to the same email address, as long as they have different passwords. Don't ask how I discovered this or what happens if you change the passwords to be the same.

Buy new phone. Copy photos from old phone. Turn on cloud backup. "Your cloud storage is full." Delete photos from cloud. Photos deleted from phone because backup is on. 🫠 That is not what a "backup" is, Google.

Bastille Day 🇫🇷, Independence Day 🇺🇸, Canada Day 🇨🇦 are all in July. Isn’t it a nice coincidence that all these events happened in the middle of summer so we can enjoy national holidays in good weather. 😎 The pattern also holds down under: Australia Day 🇦🇺 is Jan 26, Waitangi Day 🇳🇿 is Feb 6.

If someone give you used baby stuff, the important thing is not whether it is useful to you, the important thing is that giving it away is a commitment device for them not having another baby.

A handsome red bike, abandoned. By a busy road, outside my home. Locked to a tow away sign. What happened to its owner? Not even a thief has come for it. What will the HOA do? I see it daily and wonder.

A red bike in good condition locked to a signpost bearing a tow away sign, with a busy road in the background.

You should only cite papers that you have read thoroughly. You should be confident that the papers you are citing are correct; you should also apply due diligence to the references therein. To be safe, you should probably not cite anything, unless maybe it's a self-citation.

I can't believe that in 2026 bibliographies are still more likely to tell you which page of the printed journal the article is on or which city the publisher is based in than to give you a URL. Were page numbers *ever* useful? Did print journals not have a table of contents?

Here's an example of a "hallucinated" citation from a decade ago (i.e. pre-LLMs). The same bad citation appeared in multiple papers. I eventually traced the source to Google Scholar (and it's now fixed).

[2] Marcus Hardt and Jonathan Ullman. Preventing false discovery in interactive data analysis is
hard. In Foundations of Computer Science (FOCS), 2014 IEEE 55th Annual Symposium on, pages
454–463. IEEE, 2014.

From: https://arxiv.org/abs/1510.03349[11] Marcus Hardt and Jonathan Ullman. Preventing
false discovery in interactive data analysis is hard.
In Foundations of Computer Science (FOCS), 2014
IEEE 55th Annual Symposium on, pages 454–463.
IEEE, 2014.

From: https://proceedings.mlr.press/v51/russo16.pdf[19]
Marcus Hardt and Jonathan Ullman. 2014. Preventing false discovery in interactive data analysis is hard. In IEEE Symposium on Foundations of Computer Science (FOCS). 454--463.

From: https://dl.acm.org/doi/10.1145/3139550.3139556Article (Correct)

Preventing False Discovery in Interactive Data Analysis Is Hard
Authors: Moritz Hardt, Jonathan Ullman
FOCS '14: Proceedings of the 2014 IEEE 55th Annual Symposium on Foundations of Computer Science
Pages 454 - 463
https://doi.org/10.1109/FOCS.2014.55
Published: 18 October 2014 Publication History

From: https://dl.acm.org/doi/10.1109/FOCS.2014.55

While I generally agree with this policy, the focus on hallucinated citations specifically makes me uncomfortable: I usually get my BibTeX from Google Scholar. Yes, GS is sometimes wrong. No, I don't carefully check my references. Is using AI to fill in references really morally any different?

Mark Riedl@markriedl.bsky.social · 3mo ago

ArXiV has a new LLM policy (Screenshots with alt text so you don’t have to click through to the other place and see all the stupid responses)

Attention @arxiv authors: Our Code of Conduct states that by signing your name as an author of a paper, each author takes full responsibility for all its contents, irrespective of how the contents were generated. 1/

I did a back-of-the-envelope calculation to satisfy my curiosity: A standard gasoline/petrol pump delivers about 15 megawatts of energy. (In contrast, the fastest electric vehicle chargers deliver half a megawatt.)

My cynical hypothesis for why there's a lot of discussion about datacenters in space is that Elon needed a justification for merging xAI with SpaceX. Elon being the CEO of both is an obvious conflict of interest, so he needed to explain to investors why it made sense -- hence space datacenters.

Re. AI "consciousness" takes: I would be interested to read something from a psychiatry or psychology perspective. People who have spent time debugging human intelligence might have something insightful to say about artificial intelligence.