Zachary Lipton

@zacharylipton.bsky.social

Cofounder & CTO @ Abridge, Raj Reddy Associate Prof of ML @ CMU, occasional writer, relapsing 🎷, creator of d2l.ai & approximatelycorrect.com

💡Can we trust synthetic data for statistical inference? We show that synthetic data (e.g., LLM simulations) can significantly improve the performance of inference tasks. The key intuition lies in the interactions between the moment residuals of synthetic data and those of real data

Bild

Google miles behind Open/Anth til overnight boom 2.5. Mosaic models underwrite $1B until boom mothballed. Deepseek turns world upside down, but only for 5min. The speed at which the winds turn here is truly wild.

Unlike OpenAI, ostensibly controlled by a powerful holding entity, here have effectively 0 board power. This saga's shaping up like the Asimov's Spacer novels, but instead of each book exploring a different ratio of humans to robotic servants, it's a different level of corporate oversight.

Zachary Lipton@zacharylipton.bsky.social · last yr.

OpenAI folks getting creative about corporate governance. I've seen this movie before... www.theinformation.com/articles/thi...

CTO’s the most slippery title in the world. Depending on the company, you’re either 1. A technical founder who never wanted to manage, now an IC engineer 2. A VP of Engineering 3. Leading all of EPD (+AI) 4. An influencer with no internal responsibilities

Can't find any person or AI that can explain Luka → Lakers. Only satisfying theory I can conjure: behind-the-scenes feud → "calf strain" masking a relationship strain → trade demand. But according to ChatGPT's research, Luka was blindsided by the trade.

How to **efficiently** build personalized language models **without** textual info on user preferences? Our Personalized-RLHF work: - light-weight user model - personalize all *PO alignment algorithms - strong performance on the largest personalized preference dataset arxiv.org/abs/2402.05133

Excited to attend #NeurIPS this year. AI research has never been more impactful and yet its core identity, key initiatives, and trajectory have never been less clear. Looking forward to meeting a new generation of talent, to having wild conversations, & to reconnecting w old friends.

Meta-comment. Nested quote-{dunks, replies} are a navigation nightmare. One arrives at the last reply and must read the thread per reverse chronology, clicking through each tweet in sequence to get to the origin. Would love a navigation tool that jumps to the origin, progressively zooms out.

Anshul Kundaje@anshulkundaje.bsky.social · 2y ago

I'm with @arjunraj.bsky.social on this one. One point is that I think it would get even harder to take risks with research & pursue potentially resource heavy projects, if one has very limited resources since u end up having less of a buffer. 1/

This morning Uber Business Comfort was cheaper than UberX. Now questioning everything I thought I knew about Uber’s pricing model & constrained optimization. Is no inequality sacred? Is math real? Are corporations not only heartless but irrational? Checking into psych ward. Send thoughts & prayers.

What BlueSky got right that Mastodon got wrong. For the 99% of users that don’t give a FF about federation, it works exactly like old Twitter, and they never need to know. Classic Apple-epitomized design principle: Advanced features should be easy to access but, when unwanted, disappear entirely.