Nikhil Thorat

@nst.bsky.social

AI quality at Databricks. Past: Co-founder of Lilac AI, acquired by Databricks. Co-created TensorFlow.js and Know Your Data. Google Brain // PAIR // Responsible AI. nsthorat@ over there

There’s a lot of chatter of “AI solving software by the end of 2025”, which IMO is way off the mark. I useful to break things down into milestones 🧵

We just released the Databricks synthetic evals SDK! 🎉 We’ve found that synthesizing evals is a great way to hill climb your AI system before you’re able to get labels from domain experts. We’ve also recently release a new diff UI that lets you both qualitatively and quantitatively view results!

Bild

This query sold me on Perplexity Trying to understand if PCM will block sunlight for plants for a friends greenhouse. He wanted a fully natural way of keeping it warm in the winter. The answer was deep in academic papers that aren’t normally summarized by other search engines.

Bild

Something about the blue color on this app makes it feel so much friendlier than X. Not to mention I now get overtly racist anti-indian memes now over there…

My twitter notifications are mostly spam / bots that have bios trying to convince me to click a link to go on a date with them. Let’s try to make this app work.

Bluesky nailed the “omg I want an invite” even though features are identical. I don’t like when someone yells “8$” and makes me feel bad about it. Carrots not sticks!