*SHROOM Shared Task

@shroom-st.bsky.social

*SHROOM Shared-Task Series on Hallucinations and Related Observable Overgeneration Mistakes. This year we go for multimodal: SHROOM-Visions 2026.

🎉Paper notifications OUT! Congratulations on your system description paper! Please prepare and submit your camera-ready version by taking the reviewers’ suggestions into account. - Camera-ready due: Sep 11 - Page limite: 5 - Make sure to include our overview and dataset papers #SHROOM_ST #EMNLP26

Follow the instructions and register for EMNLP if you wish to attend SHROOM-V shared task!! Looking forward to seeing many of you 🤗🤗 #emnlp2026 #SHROOM_ST #NLProc

EMNLP@emnlpmeeting.bsky.social · 3w ago

Registration for #EMNLP2026 is officially open! 🇭🇺 Authors, please note registration deadlines: Sept 11 (Main) and Sept 24 (Workshops). You can find all the details under the Accepted Paper Information on the registration page. 🔗 2026.emnlp.org/registration/

The *SHROOM series is designed to stress-test core issues in hallucination evaluation, like black- v. white-box (SHROOM) or multilinguality (mu-SHROOM). For SHROOM-Visions, the hidden angle was benchmark obsolescence. Making the SHEEP dataset to answer that was a lot of work, but also a lot of fun 🐑

*SHROOM Shared Task@shroom-st.bsky.social · last mo.

🌟Final leaderboard available: helsinki-nlp.github.io/shroom/2026 📰 SHEEP dataset paper available on arXiv: arxiv.org/abs/2608.01021 Deadline for system description paper: Aug. 10 AoE. Happy writing! #SHROOM_ST #NLProc @emnlpmeeting.bsky.social

Apparently ACL is absolutely loaded with mushrooms, and our organizers seem way too enthusiastic about them 🙈 Can someone keep an eye on these guys, plz? We’ve got a shared task to finish for EMNLP before they disappear into the forest. 😳🍄 #SHROOM_ST #NLP @emnlpmeeting.bsky.social

BildBild
*SHROOM Shared Task@shroom-st.bsky.social · 2mo ago

Some of our organizers @linguistickus.bsky.social and Aman are @aclmeeting.bsky.social this week. Don’t be shy—reach out if you have any questions, or even just to say hi! 👋

Some of our organizers @linguistickus.bsky.social and Aman are @aclmeeting.bsky.social this week. Don’t be shy—reach out if you have any questions, or even just to say hi! 👋

*SHROOM Shared Task@shroom-st.bsky.social · 2mo ago

⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/participant_kit.shroom_visions.zip The kit contains a format checker, the scoring program, a constant-baseline, and a more involved setup for more realistic system. #sharedtask #hallucination @emnlpmeeting.bsky.social