I’ve tested the new llama 3.3 70b 🦙 and the instruction following so far is magnifique. 👌
Marco Herzog
@marcoher.bsky.social
Connecting AI research & Applied AI since 2018 | Previously: ML, NLP, RecSys | Now: GenAI, LLMs, RAG | Natural science, tech and climbing is my thing.
Tencent open sourced this, Impressive! But I think we need to start talking about AI generated content detection on social media more seriously … This open source is 🤯 More content with other capabilities in 🧵 aivideo.hunyuan.tencent.com
This essay from DeepMind is something you shouldn't miss, it made me very excited about the future of science. A new golden age of discovery Seizing the AI for Science opportunity deepmind.google/public-polic... #AI #ML #Science
A new golden age of discovery
In this essay, we take a tour of how AI is transforming scientific disciplines from genomics to computer science to weather forecasting. Some scientists are training their own AI models, while...
deepmind.google
If this is not telling an interesting story, than what does? Accenture makes more money with GenAI than OpenAI. GenAI revenue: OpenAI: $3.4bn Accenture: $3.7bn I’m still thinking what that means…
Unveiling the true inspiration behind the ‘attention’ operator in Transformers! From Bahdanau’s emails to Karpathy, we learn how attention transformed neural networks. Surprising that ‘Attention is All You Need’ outshines its predecessor by Bahdanau et al. #AI #ML #Transformers
Cursor vs Windsurf I just spent a week deep-diving into Cursor and Windsurf, so you don’t have to. Here's everything you need to know 👇🧵
A new update on the AI feed. The feed now has 66 unique negative filters. They remove any form of AI art. There are 186 filters that are filtering content related to the sphere of AI. bsky.app/profile/did:... #AI #LLM #ML
@bsky.app Impression stats are really missing. Not necessarily visible for everyone on the post, but at least for the post creator. 1. To know how big the audience really is 2. To see the actual quality of post (engagement/Impressions)
Do you want to see the new Anthropic Model Context Protocol in action? It was announced just 3 d ago, and we already see great apps. This time build by Alec Velikanov. Take this project as an example to build something yourself. I'm off, need to cook 7 courses with the stuff Claude ordered. #AI
I've updated the filters for the AI feed. Using 186 filters in total now. Feel free to ping me if you want the filter list. bsky.app/profile/did:... #AI #LLM #ML
Once moving away from naive RAG, chunking becomes pretty important. I use semantic chunking with BERT, and I'm quite happy with it. I didn't use this, but looks promising. Quite handy if you don't use bigger libs like Haystack, LangChain, LLamaIndex etc. github.com/bhavnicksm/c... #LLM #RAG #AI
GitHub - bhavnicksm/chonkie: 🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library
🦛 CHONK your texts with Chonkie ✨ - The no-nonsense RAG chunking library - bhavnicksm/chonkie
github.com
I used to think #LLM were just fancy next-token parrots. Turns out they’re secretly doing math. The end of Scaling laws? Surprise! Your #AI can now do symbolic reasoning. I can't be more thrilled to let it do my taxes. arxiv.org/html/2407.11... Hopefully it doesn't think in these symbols:
I had a talk with Elena Samuylova from Evidently AI and she was super helpful. Evidently is an open-source framework to evaluate, test and monitor ML and LLM-powered systems. Does anyone have experience with it in prod env or an opinion on other eval tools?
An AI starter pack to get quickly into the community by following the most active members. The goal is to get meaningful content fast and engage with the community. Please tag very active members in the comments to add them into the list. go.bsky.app/CanJ3xW #AI #ML #starterPack
I like his brutal honesty. 😆 "...in my opinion there's like 5% of an idea and then 95% is like smoke and mirrors trying to couch things in modern words that have already existed for a long time, and they're fundamentally nothing new. I don't want to be too harsh..." www.youtube.com/watch?v=gfU5...
TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters (Paper Explained)
YouTube video by Yannic Kilcher
youtube.com
Navigating Bluesky's content curation tools 🧭 • Lists: Organize accounts • Moderated Lists: Tighter content control • Starter Packs: Onboard new users (max 150) • Feeds: Custom algorithmic timelines I was lost at first, but here's what I learned! 🧵👇
Actually, an interesting thought for generalization in AI. It seems there is a connection between spacial location and latent context similarly to influence decision-making, despite the task being non-spatial, at least in the hippocampus. Is not Fei-Fei Li currently working on something similar?
Huge congrats to @karyna-mi.bsky.social for her paper published today in Science! She found that the hippocampus is really important for a key strategy we use to make decisions called hidden state inference! 🧪 🧠https://www.science.org/doi/10.1126/science.adq5874 1/7
Feel free to ping me, if I haven't added you to the RAG - Retrieval Augmented Generation starter pack yet. go.bsky.app/PUts9PH
Feel free to ping me, if I haven't added you to the AI Agents starter pack yet. Enjoy the community. go.bsky.app/U8M5Rk6
Just created a starter pack to get a steady stream of Applied AI related conversations! Think RAG in Enterprises, Structured Extraction from documents, AI in consumer apps and Agents! I will keep adding folks to this list! Who else should I add?! https://buff.ly/3ObxkCD
Applied AI Folks!
Join the conversation
buff.ly
🔬 𝗔𝗜 𝗔𝗧 𝗪𝗢𝗥𝗞 — 𝗘𝗻𝗵𝗮𝗻𝗰𝗶𝗻𝗴 𝗘𝗳𝗳𝗶𝗰𝗶𝗲𝗻𝗰𝘆, 𝗗𝗶𝗺𝗶𝗻𝗶𝘀𝗵𝗶𝗻𝗴 𝗦𝗮𝘁𝗶𝘀𝗳𝗮𝗰𝘁𝗶𝗼𝗻 New MIT study. The numbers tell a striking story: • Overall 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝘃𝗶𝘁𝘆 ⬆️ 𝟰𝟰% • Patent filings ⬆️ 39% • BUT 𝗷𝗼𝗯 𝘀𝗮𝘁𝗶𝘀𝗳𝗮𝗰𝘁𝗶𝗼𝗻 ⬇ 𝗳𝗼𝗿 𝟴𝟮% Here's the twist: • Top performers: 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝘃𝗶𝘁𝘆 𝘀𝘂𝗿𝗴𝗲 ⬆️ 𝟴𝟭% • Bottom third: Minimal gains
@bsky.app Seems like you are getting momentum. Congrats! Feels like a lot of excitement and genuine interactions are shared here. Would you mind sharing any features and other plans users can expect for the future?
So Jack changed from 🐤 to 🦋. So we don't tweet anymore, but… click?
I've created a list of 𝗟𝗟𝗠 𝗹𝗲𝗮𝗱𝗲𝗿𝗯𝗼𝗮𝗿𝗱𝘀. 🕶️ Share it, grow it, enjoy it! Link to the GitHub page: github.com/git-git-hurr...
You heard about DSPy? Let's talk TextGrad. The upgraded version in AI optimization. I've been diving into TextGrad lately, and I thought I'd share some insights. It's a Python framework from Stanford that's making waves in AI optimization. Here's the lowdown: 🧵