Pedro Cuenca

@pcuenq.hf.co

ML Engineer at Hugging Face

Google's FunctionGemma is out 🥳 smol 🤏 270M (not B!) parameters model. Why is this interesting? 🔨 Designed for tool calling. 📲 Perfect for on-device use. 👌 Dramatically increases performance on your domain with fine-tuning.

JetBrains has been quietly building something special for the open-source LLM community. More details will be posted soon on Hugging Face. Stay tuned! 🧑‍💻

Bild

Announcing Global-MMLU - an improved MMLU Open dataset with evaluation coverage across 42 languages. The result of months of work with the goal of advancing Multilingual LLM evaluation. Built together with the community and amazing collaborators at Cohere4AI, MILA, MIT, and many more.

Bild

🤔 Do you ever wonder how companies are putting LLMs and GenAI apps into production? What stacks do they use? What architecture did they go with? I put together a database of known public technical writeups with summaries of the key technical features.

GIF of me scrolling through the LLMOps database website

I've been exploring the latest Llama 3.2 releases and working on a couple of projects you may find interesting: 1️⃣ Understanding tool calling with Llama 3.2 🔧 2️⃣ Using Text Generation Inference (TGI) with Llama models 🦙 (links in the next post)

Bild

This is insane! Structured generation in the browser with the new @hf.co SmolLM2-1.7B model • Tiny 1.7B LLM running at 88 tokens / second ⚡ • Powered by MLC/WebLLM on WebGPU 🔥 • JSON Structured Generation entirely in the browser 🤏

Fuck it! Structured Generation w/ SmolLM2 running in browser & WebGPU 🔥 Powered by MLC Web-LLM & XGrammar ⚡ Define a JSON schema, Input free text, get structured data right in your browser - profit!!

FYI, I muted this conversation, I am blocking some users and reporting others because since yesterday I am receiving death threats and plenty of harassment. For something I didn't do. Wasn't Bluesky different than other social networks? I am no longer willing to engage in this conversation.

Giada Pistilli@giadapistilli.com · 2y ago

Hi all. You asked for an explanation from me, so here it is: 1/ What happened yesterday with my colleague's dataset was inappropriate and unethical. It has been taken down, and all the data has been deleted. I am truly sorry if this has made Bluesky users feel unsafe, it was never the goal.

A librarian that previously worked at the British Library created a relatively small dataset of bsky posts, hundreds of times smaller than previous researchers, to help folks create toxicity filters and stuff. So people bullied him & posted death threats. He took it down. Nice one, folks.

I'm disheartened by how toxic and violent some responses were here. There was a mistake, a quick follow up to mitigate and an apology. I worked with Daniel for years and is one of the persons most preoccupied with ethical implications of AI. Some replies are Reddit-toxic level. We need empathy.

Daniel van Strien@danielvanstrien.bsky.social · 2y ago

I've removed the Bluesky data from the repo. While I wanted to support tool development for the platform, I recognize this approach violated principles of transparency and consent in data collection. I apologize for this mistake.

SmolVLM was just released 🚀 It's a great, small, and fully open VLM that I'm really excited about for fine-tuning and on-device use cases 💻 It also comes with 0-day MLX support via mlx-vlm, here's it running at > 80 tok/s on my M1 Max 🤯

Smol TTS keeps getting better! Introducing OuteTTS v0.2 - 500M parameters, multilingual with voice cloning! 🔥 > Multilingual - English, Chinese, Korean & Japanese > Cross platform inference w/ llama.cpp > Trained on 5 Billion audio tokens > Qwen 2.5 0.5B LLM backbone > Trained via HF GPU grants

Check out how easy it is to do LLM evals with LightEval! * any dataset on the 🤗 Hub can become an eval task in a few lines of code: customize the prompt, metrics, parsing, few-shots, everything! * model- and data-parallel inference * auto batching with the new vLLM backend

A screenshot of LightEval benchmarking results in a terminal