We are very happy to announce our next seminar: Pedro Ortiz Suarez @pjox.bsky.social ( @commoncrawl.bsky.social ) "Expanding Linguistic and Cultural Coverage in Common Crawl" on Friday 12th June 2026, 11am CEST. Details here 👉 almanach.inria.fr/seminars-en....

Blocking the Internet Archive Won’t Stop AI, But It Will Erase the Web’s Historical Record www.eff.org/deeplinks/20... @eff.org

Blocking the Internet Archive Won’t Stop AI, But It Will Erase the Web’s Historical Record

Imagine a newspaper publisher announcing it will no longer allow libraries to keep copies of its paper. That’s effectively what’s begun happening online in the last few months. The Internet Archive—th...

eff.org

The Common Crawl team presented a seminar at Stanford HAI entitled “Preserving Humanity's Knowledge and Making it Accessible: Addressing Challenges of Public Web Data”. commoncrawl.org/blog/common-...

Common Crawl - Blog - Common Crawl Foundation at Stanford HAI

The Common Crawl team presented a seminar at Stanford HAI entitled “Preserving Humanity's Knowledge and Making it Accessible: Addressing Challenges of Public Web Data”.

commoncrawl.org

If you were able to join us, let us know about your experience: docs.google.com/forms/d/e/1F...

Thank you everyone for coming to WMDQS (pronounced "whim ducks")!

WMDQS is underway! Come join us in Room 520A at @colmweb.org! #COLM2025

Looking forward to tomorrow's #COLM2025 workshop on multilingual data quality! 🤩

Workshop on Multilingual Data Quality Signals@wmdqs.bsky.social · 10mo ago

In collaboration with @commoncrawl.bsky.social, MLCommons, and @eleutherai.bsky.social, the first edition of WMDQS at @colmweb.org starts tomorrow in Room 520A! We have an updated schedule on our website, including a list of all accepted papers.

In collaboration with @commoncrawl.bsky.social, MLCommons, and @eleutherai.bsky.social, the first edition of WMDQS at @colmweb.org starts tomorrow in Room 520A! We have an updated schedule on our website, including a list of all accepted papers.

We introduce the TableEval benchmark and investigate the effectiveness and robustness of text-based and multimodal LLMs on table understanding through a cross-domain & cross-modality evaluation. Joint work by DFKI SLT incl. Fabio Barth, Raia Abu Ahmad, @malteos.bsky.social @pjox.bsky.social

If you want to help us improve language and cultural coverage, and build an open source LangID system, please register to our shared task on Language Identification! 💬 Registering is easy! All the details are on the shared task webpage: wmdqs.org/shared-task/ Deadline: July 23, 2025 (AoE) ⏰

Common Crawl Foundation@commoncrawl.bsky.social · last yr.

The Common Crawl Foundation, MLCommons, EleutherAI, and John Hopkins' Center for Language and Speech Processing have the pleasure of inviting you to register for the 1st shared task on Language Identification for web data. commoncrawl.org/blog/wmdqs-s...

Just a few days left to contribute annotations before the first release of training data. We have over 17,000 document annotations so far!

Catherine Arnett@catherinearnett.bsky.social · last yr.

One of the biggest obstacles to improving language technologies for low-resource languages is the lack of data. To address this, we need better language identification tools. So, we're organizing a shared task on Language Identification for Web Data! #NLP #NLProc

In June 2025 the Common Crawl Foundation, MLCommons, and EleutherAI had the pleasure of hosting a virtual hackathon in partnership with Masakhane in order to collect language identification annotations for African languages. commoncrawl.org/blog/the-fir...

Common Crawl - Blog - The First WMDQS-Masakhane LangID Hackathon

In June 2025 the Common Crawl Foundation, MLCommons, and EleutherAI had the pleasure of hosting a virtual hackathon in partnership with Masakhane in order to collect language identification annotation...

commoncrawl.org

The Common Crawl Foundation team took part in the United Nations Open Source Week in New York City this June, meeting with global developers, researchers, and policymakers to discuss all things open source and AI. commoncrawl.org/blog/common-...

Common Crawl - Blog - Common Crawl at the United Nations Open Source Week, June 2025

The Common Crawl Foundation team took part in the United Nations Open Source Week in New York City this June, meeting with global developers, researchers, and policymakers to discuss all things open s...

commoncrawl.org

The deadline for paper submissions has been extended! The new deadline is July 3, 2025. AoE. For more information, please visit: wmdqs.org

Common Crawl Foundation@commoncrawl.bsky.social · last yr.

Call for papers! We are organising the 1st Workshop on Multilingual Data Quality Signals with @mlcommons.org and @eleutherai.bsky.social, held in tandem with @colmweb.org. Submit your research on multilingual data quality! Submission deadline is 23 June, more info: wmdqs.org

The Common Crawl Foundation, together with IBM, the AI Alliance, and BrightQuery will be hosting an "UN Conference" at IBM's new flagship NYC HQ at One Madison Avenue on Friday, June 20, from 12:30-5pm. If you are in NYC, it would be great to see you there! lu.ma/p0a1scde

AI Alliance @ IBM One Madison (UN Open Source Week 2025) · Luma

This year’s UN Open Source Week 2025, June 16-20) will once again bring together a global “who is who” of Open Source leaders. As part of the official…

lu.ma

Call for papers! We are organising the 1st Workshop on Multilingual Data Quality Signals with @mlcommons.org and @eleutherai.bsky.social, held in tandem with @colmweb.org. Submit your research on multilingual data quality! Submission deadline is 23 June, more info: wmdqs.org

I’ll be running the Paris Marathon this Sunday for cancer research and treatment 🏃🏻‍♂️ Please donate if you can! Every donation no matter how small, helps immensely. marathon-paris.dossards-solidaires.org/fundraisers/...

Running a Marathon for Cancer Research (Gustave Roussy Institute)

Chers amis et famille, J'ai décidé de courir le Marathon de Paris 2025, mais cette fois-ci j'ai choisi de courir pour l'Institut Gustave Roussy, premier centre de lutte contre le cancer en Europe tant...

marathon-paris.dossards-solidaires.org

Pedro Ortiz Suarez@pjox.bsky.social · 2y ago

I decided to run the 2025 Paris Marathon for the Gustave Roussy Institute, the Leading Cancer Centre in Europe. This is a cause close to my heart, as cancer has touched my family, my friends and colleagues: marathon-paris.dossards-solidaires.org/fundraisers/...

We would like to welcome all of our attending members to Oslo, with a special welcome to two of our newest members, the Publications Office of the European Union and @commoncrawl.bsky.social! @nettarkivet.bsky.social | #iipcGA25 | #webarchiving

Today is "I love Free Software Day". Thank you to the @commoncrawl.bsky.social Foundation for all their hard work. Onwards! @pjox.bsky.social - So great to meet in person.

Internet Archive Europe@internetarchive.eu · last yr.

It feels like forever ago, but only last weekend we were at @fosdem.bsky.social and had a great hallway discussion with the Software Heritage Foundation. We look forward to collaborating even more. Thank you for all your amazing work preserving Software.

I’ll be today at the AI Action Summit in Paris, if you’re attending and want to discuss about @commoncrawl.bsky.social or about open data, please DM me!

We're very happy to release cc-downloader, a new CLI tool to download Common Crawl data 📚🚀🧑‍💻 ‍cc-downloader is still under active development, so if you find any issues or would like to submit a feature request, please visit its GitHub repository at github.com/commoncrawl/....

GitHub - commoncrawl/cc-downloader: A polite and user-friendly downloader for Common Crawl data

A polite and user-friendly downloader for Common Crawl data - commoncrawl/cc-downloader

github.com

Common Crawl Foundation@commoncrawl.bsky.social · 2y ago

If you care about open data or anything related to crawling, The Common Crawl Foundation @commoncrawl.bsky.social is now on Bluesky 📊📈📚🥳

Ran the Berlin marathon yesterday and while it was not my best marathon and I was recovering from injury, I had an amazing time. I really hope I can do better next year in Paris where I'll run for cancer research. If you can donate please do so: marathon-paris.dossards-solidaires.org/fundraisers/...

I decided to run the 2025 Paris Marathon for the Gustave Roussy Institute, the Leading Cancer Centre in Europe. This is a cause close to my heart, as cancer has touched my family, my friends and colleagues: marathon-paris.dossards-solidaires.org/fundraisers/...

Marathon for Gustave Roussy Institute

Chers amis et famille, J'ai décidé de courir le Marathon de Paris 2025, mais cette fois-ci j'ai choisi de courir pour l'Institut Gustave Roussy, premier centre de lutte contre le cancer en Europe tant...

marathon-paris.dossards-solidaires.org

Ran the Paris Marathon yesterday. It was an amazing experience. Getting into running was probably the best decision I’ve made in recently. It has helped massively with both physical and mental health. I highly recommend any type of physical activity, especially for researchers 🏃🏻‍♂️

I still don’t know how, but I finished my first marathon in 5:03:04 🥹

Very happy to announce this new release of @oscarproject.bsky.social 🥳. We're still working on documentation so please be patient, more details and features are coming soon! 👀 We're always open for feedback and collaboration, so please join our community: https://t.co/toLKAPje4E

OSCAR Project@oscarproject.bsky.social · 3y ago

📣 The OSCAR Project and DFKI are happy to announce the release of Colossal OSCAR 1.0 📚, which is now available on the Hugging Face Hub 🤗 at https://huggingface.co/datasets/oscar-corpus/colossal-oscar-1.0 Colossal OSCAR 1.0 was put together by @pjox.bsky.social as part of the OpenGPT-X collaboration.

Ran half a marathon today and had to stop to buy water as I was feeling dehydrated and had already finished all my water. Had to pay 5.50 € for that bottle of water just because someone had the amazing idea of building a massive park without any water fountains 😠🥵🏃🏻‍♂️