Kenny Peng

@kennypeng.bsky.social

CS PhD student at Cornell Tech. Interested in interactions between algorithms and society. Princeton math '22. kennypeng.me

One intuition behind many AI policy proposals is that downstream AI applications -- the companies deploying AI in healthcare, finance, education, customer service, etc. -- should bear responsibility for ensuring safety. Our paper asks: What incentives does that create for the firms building AI?

Illustrative example of our game-theoretic model. This numeric instance of the game consists of one general-purpose producer and three domain-specialists. Each player has a different utility in performance-safety space which dictates the path of development. Within this setting, the no-regulation game (Upper Left) reveals the players’ investment efforts when no floor is imposed on safety. Regulating the domain-specialist alone (Upper Right) exhibits backfiring for all three domains, meaning the regulated safety level is lower than it would be without regulation. In this particular example, the same floor is assumed for all three domain-specialists. Regulating the generalist alone (Lower Left) improves the safety level slightly across all three domains, compared to no-regulation. Finally, a regime that targets both generalists and specialists with regulation (Lower Right) is able to 1) retain the improved safety performance from regulating the generalist, 2) improve the safety level of least-safe domain-specialist, while 3) avoiding backfiring. The purpose of this figure is to visualize the model’s incentive mechanisms; none of these panels represent real regulations.

🧵Can we reconcile excitement for SAEs with negative results? Our #ICML2026 position paper argues that even if SAEs underperform baselines when acting on knowns (e.g. probing, steering), they're a powerful tool for ~discovering unknowns~ Poster: Tue 2pm, HALL A #1715

Bild

Presenting this at #COLT2026! Let me know if you want to chat about (1) the linear representation hypothesis, (2) theoretical foundations for interpretability / science of AI. - Talk: Thursday 2:33 pm - Deep Learning Theory / Optimization - Poster: Thursday Lunch)

Kenny Peng@kennypeng.bsky.social · 6mo ago

New paper! The Linear Representation Hypothesis is a powerful intuition for how language models work, but lacks formalization. We give a mathematical framework in which we can ask and answer a basic question: how many features can be stored under the hypothesis? 🧵 arxiv.org/abs/2602.11246

In college, I wrote this essay about Clark Kimberling, who maintains the Encyclopedia of Triangle Centers. The essay covers triangle geometry's rise (which includes Napoleon), its fall (from "brute force" methods), and its continued following ("the melody lingers on")

Coincidence of Lines

The mathematician Clark Kimberling estimates that he spends between two and five hours each day, seven days a week, maintaining his online encyclopedia of triangle centers.

leaflet.pub

We are very excited to announce our first workshop on From Theory to Practice: behind the scenes on research deployments at EC’26 (July 6 in Rome)! Call for posters and submissions now open! Organized by myself, @ericachiang.bsky.social , Bailey Flanigan, @brwilder.bsky.social

Home

About This workshop will focus on the practical realities of deploying algorithmic and economic systems from academic research, especially with government and non-profit partners. While economics and ...

sites.google.com

We made traversle.io, a new daily word game! The goal is to traverse from a start word to a target word through a network of related words. (Our motivating question: is it possible to construct a network that allows human navigation?)

Very cool — a way to jump from one post onto a trail of related posts. Lots of possibility and opportunity to push beyond the feed interface!

spacecowboy@spacecowboy17.bsky.social · 4mo ago

Introducing a new way to explore Bluesky: foryou.club/also-liked Enter a post URL to see what other posts people who liked it also like. For example, enter the url of this art post: bsky.app/profile/alar... and you will get a bunch more art posts: foryou.club/also-liked?p...

Loved reading this. The premise that social media should let us actively traverse it through connections, not just scroll a feed feels exactly right. One thought it raised for me: Trails (& rabbit holes) are often spaces we wander through alone. What would a more social analogy get us?

Kenny Peng@kennypeng.bsky.social · 4mo ago

🧵 On social media, we feel trapped in “filter bubbles” and “echo chambers.” Often, we see this as a problem with the algorithm. Our new essay argues the problem is the feed interface itself: it constrains our movement—all we can do is scroll. We lay out an alternative vision:

I have really enjoyed talking with Kenny about his work on alternative rec system mechanisms. This work offers a vision of user-powered concept exploration: imagine the social media feed equivalent of the joy of exploring wikipedia by navigating trails of hyperlinks from one article to the next.

Kenny Peng@kennypeng.bsky.social · 4mo ago

🧵 On social media, we feel trapped in “filter bubbles” and “echo chambers.” Often, we see this as a problem with the algorithm. Our new essay argues the problem is the feed interface itself: it constrains our movement—all we can do is scroll. We lay out an alternative vision:

New in Nature Health: how might we move towards a world in which race is not used in clinical algorithms? We need (1) careful comparison of race-aware and race-neutral algorithms and (2) systemic efforts to address underlying disparities.

New paper! The Linear Representation Hypothesis is a powerful intuition for how language models work, but lacks formalization. We give a mathematical framework in which we can ask and answer a basic question: how many features can be stored under the hypothesis? 🧵 arxiv.org/abs/2602.11246

Bild

I had a lot of fun making this map of Manhattan’s grid (only the numbered streets and avenues). Learned that 4th avenue doesn’t exist, but then learned that it actually does exist but only for a few blocks.

Urban Data@urban-data.bsky.social · 9mo ago

For #30DayMapChallenge day 11, a minimal map from @kennypeng.bsky.social. Kenny extracts minimal elements from a not-as-minimal-as-it-seems object: the Manhattan street grid. "I show how Manhattan’s numbered grid of streets and avenues is more complicated than you might realize," he says.