A series of technical reports from our project, like the one just posted by our colleague @klein-aaron.bsky.social, will try to provide answers to the many questions that LLM training teams cope with around the globe. This one is about training recipes 👇

@klein-aaron.bsky.social · 2w ago

🚀 How do you choose the right LLM training recipe? We just released a tech report on the scaling-law pipeline of @openeurollm.bsky.social 🇪🇺, along with the corresponding checkpoints, data, and code. arxiv.org/abs/2608.28308 1/N 🧵

Our 9B experimental WIP model now named 🎼 PRELUDE is still training but we are sharing intermediate checkpoints for transparency: 🛑 WIP research artifact. 🛑 NOT cooled down yet. ✔️Include validation across 36 languages. Full WIP model card👇 huggingface.co/openeurollm/...

openeurollm/prelude · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

huggingface.co

We are at 1/3 of training our 9B model! 🏃🏃🏃 ✨Follow progress here: huggingface.co/spaces/opene... 🪇See our public Weights & Biases training workspace here: wandb.ai/openeurollm-... More soon! #TransparentAI #OpenScience #goOpenEuroLLM

OpenEuroLLM 9B Progress - a Hugging Face Space by openeurollm

Live pretraining progress for OpenEuroLLM 9B

huggingface.co

Input, more input 🤖⚡ Just like Jonny 5 in Short Circuit, our baby model is reading every single token from its pretraining dataset. So far: 10 trillion tokens, 36 languages + code & math as their own "languages" 📚🌍💻 We’re tracking progress & sharing it openly 👇 (1/2)

Ally Sheedy and Johnny 5 in Short Circuit

ALT: Ally Sheedy and Johnny 5 in Short Circuit

static.klipy.com

Pretraining launched!🚀 Our 9B/10TT baby model is making its first steps in Leonardo (CINECA). 🐣 All people involved are eager to see the results of the effort it took to get here and share them. 👀 And advancing to push hard for the next cycle. 🦾 #goOpenEuroLLM

Wrapping up our 3rd general meeting, hosted by AI Sweden in sunny Stockholm ☀️ A full room makes the final decisions before training the first OpenEuroLLM model. Sharing updates, ideas, and future plans. Two more days of tight collaboration. Full speed mode. 🚀 #goOpenEuroLLM

HPLT is of the datasets we are sharing in our world-readable catalogue across HPCs. Interesting talk at #LREC2026 in 15 min in room Menorca 1 at 16:20!!!

All ready to share information about #OpenEuroLLM with the #LREC2026 crowd. Let's talk data, infra, evals and open multilingual LLM models together! Come to booth #5 at the poster area 1, Elyxir Building. #multingualLLMs #openLLMs #diverseLLMs #safeLLMs

Quite a nice "representation" of the OpenEuroLLM crowd will be at the International Conference on Learning Representations (ICLR) this week. On Friday 24, come to poster "OpenThoughts: Data Recipes for Reasoning Models", work partially supported by our project, and meet us! 👋

Experimenting with model-based annotation for better data selection? A candidate to consider is propella-1, a mulitlingual and multi-property annotator partially funded by #OpenEuroLLM which is fully open-source. 👍 Models, annotations and paper ready! See: huggingface.co/collections/...

🎉 One year of OpenEuroLLM! 🇪🇺We’re building Europe’s next-gen open-source LLMs to boost digital sovereignty. More about our achievements and next steps for infrastructure, data, models and evaluation at openeurollm.eu/blog/first-y.... Year 2 = full speed ahead. 🚀 Go #OpenEuroLLM!

OpenEuroLLM

A series of foundation models for transparent AI in Europe

openeurollm.eu

First OpenEuroLLM Winter School in collaboration with the Circle U university alliance 🧑‍🎓and the Nordic Language Processing Laboratory 🧑‍💻 Focus on Multilinguality in LLM Development and Evaluation with speakers from world organisations, academia and industry. More at wiki.nlpl.eu/Community/tr...

Strategic access to EuroHPC resources granted to OpenEuroLLM!!! -first AI project granted strategic access across multiple EuroHPC centres -for over 10 million GPU hours Thanks @ec.europa.eu and @eurohpc-ju.bsky.social!

OpenEuroLLM completing 2 days of sharing progress and next steps pursuing the goal of developing strong multilingual foundation models aligned with European strategic vision & standards. Gathering at BSC nearby MareNostrum 5 supercomputer made us feel home. #Barcelona #NLProc #OpenEuroLLM

⏰ Quick reminder: we're still accepting applications for our ML Scientist / Engineering positions on @openeurollm.bsky.social at the @ellisinsttue.bsky.social ! If you're keen in working on LLMs for European languages and haven’t applied yet, now’s the time! 🔗 institute-tue.ellis.eu/en/jobs/open...

Machine Learning Engineers and Scientists (OpenEuroLLM)

institute-tue.ellis.eu

📢 First release: 38 monolingual reference LLMs (2.15B params) via #HPLT + #OpenEuroLLM ⚙️Trained on 100B tokens from HPLT v2 dataset 🌍 Cover EU langs + others ⚙️ Based on LLaMA, trained on #LUMI 📈 Useful for evaluation Downloads + more info at openeurollm.eu/blog/hplt-oe...

Kick-off successfully completed. Go OpenEuroLLM team! openeurollm.eu

It's time for transparent AI in Europe. It's time for open LLMs as a robust foundation for developing future private and public AI services. It's time for: OPEN = open-source Euro = under EU regulations, representing EU values LLM = LLMs openeurollm.eu