Tessera
Folgen

Vivek Kalyan

@vivekkalyan.com

Applied AI. Building cartograph.app. Previously: Head of AI @ handshakes.ai 🇸🇬 I write (sparsely) at: vivekkalyan.com

59 Posts74 Follower169 Folgt
Vivek Kalyan@vivekkalyan.com · 2y ago

This is a super high impact project. There are tons of production models in the real world still running BERT/RoBERTa models from the 2018-2019 era, I'm sincerely hoping these models are easy to finetune, just the 8k context length will be good enough reason to upgrade.

Jeremy Howard @howard.fm · 2y ago

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

Vivek Kalyan@vivekkalyan.com · 2y ago

@eugeneyan.bsky.social's blog is a gold mine if you are doing ML/AI in the industry. Writing design docs before ML projects start is an important process that I introduced at my prev org, and the post on design docs was one of the references I used to create our template.

Eugene Yan@eugeneyan.com · 2y ago

Feels good to be mentioned on HN for engineers learning AI 🥰 Helping others is a big reason I write. Here's a list on ML/AI: ## Building AI systems • Patterns for Building LLM-based Systems: eugeneyan.com/writing/llm-... • What We’ve Learned From A Year of Building with LLMs: applied-llms.org

Read through this making flashcards as you to: https://eugeneyan.com/writing/llm-patterns/ Then spin up a RAG-enhanced chatbot using pgvector on your favourite subject, and keep improving it when you learn about cool techniques --- Lots of people can get impressive demos up and running, but if you want to run AI products in production, you're going to have to do system evals. System evals make sure your product is doing what it says on the box with unquantifiable qualities. We wrote a zine on system evals without jargon: https://forestfriends.tech Eugene Yan has written extensively on it https://eugeneyan.com/writing/evals/ Hamel has as well. https://hamel.dev/blog/posts/evals/
Vivek Kalyan@vivekkalyan.com · 2y ago

The Gemini team really delivered with gemini-exp-1121. It slaps for writing tasks, it's outputs avoid the typical AI feel that other models (like ChatGPT) have, something previously only Claude achieved.