🎉Paper notifications OUT! Congratulations on your system description paper! Please prepare and submit your camera-ready version by taking the reviewers’ suggestions into account. - Camera-ready due: Sep 11 - Page limite: 5 - Make sure to include our overview and dataset papers #SHROOM_ST #EMNLP26
*SHROOM Shared Task
@shroom-st.bsky.social
*SHROOM Shared-Task Series on Hallucinations and Related Observable Overgeneration Mistakes. This year we go for multimodal: SHROOM-Visions 2026.
🥳Our overview paper "Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models" is available on line! arxiv.org/abs/2608.25662 Participants, please check your team names and descriptions in case of mistakes. #UncertainNLP #EMNLP
Overview of SHROOM-Visions 2026: A Shared Task on Hallucination Detection in Large Vision-Language Models
In 2026, we held the fourth iteration of the SHROOM Shared Task series: SHROOM-Visions (\textbf{S}hared-task on \textbf{H}allucinations and \textbf{R}elated \textbf{O}bservable \textbf{O}vergeneration...
arxiv.org
Follow the instructions and register for EMNLP if you wish to attend SHROOM-V shared task!! Looking forward to seeing many of you 🤗🤗 #emnlp2026 #SHROOM_ST #NLProc
Registration for #EMNLP2026 is officially open! 🇭🇺 Authors, please note registration deadlines: Sept 11 (Main) and Sept 24 (Workshops). You can find all the details under the Accepted Paper Information on the registration page. 🔗 2026.emnlp.org/registration/
Reminder: reciprocal review deadline is in one week, on August 31st. Please remember to keep your comments constructive and respectful, with a focus on how the authors could improve the readability of their paper. #review #NLProc #sharedtask
🥳Happy to share that SHROOM-Vision dataset paper, SHEEP, has been accepted to the EMNLP Main conference! Congrats to all the co-authors and big thank to the #SHROOM_ST organization team! Can't wait to read it? arxiv.org/abs/2608.01021 #NLProc #sharedtask #datasets #emnlp
☑️Reviewing process starts! The nominated reciprocal reviewers will review 1-2 papers. The assignments have now been released on OpenReview. - Review deadline: **August 31** - Notification of acceptance: September 4 - Camera ready: September 11 #NLPreview #NLProc #shared_task
⌛️~28 hours left to submit your system paper! Kindly follow this template for your paper title: “Team X at SHROOM-Visions: ” - Ddl: Aug 10th, AoE - Submission: openreview.net/group?id=EMN... - Please cite the dataset paper SHEEP: arxiv.org/abs/2608.01021 #NLProc #emnlp2026 #SHROOM_ST
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
openreview.net
3️⃣ days left to submit your system paper 💪 Please use this template for your paper title “Team X at SHROOM-Visions”. Looking forward to learn about your systems! #NLProc #emnlp2026 #SHROOM_ST
Join our SHROOM shared task at EMNLP 2026 @emnlpmeeting.bsky.social in Budapest, and pushing the limites of hallucination detection in LVLMs !!
🎉 We are incredibly excited to announce the Keynote Speakers for #EMNLP2026: Pascale Fung, Graham Neubig, and Anna Korhonen! See you in October in Budapest! 🔗 2026.emnlp.org/program/keyn...
The *SHROOM series is designed to stress-test core issues in hallucination evaluation, like black- v. white-box (SHROOM) or multilinguality (mu-SHROOM). For SHROOM-Visions, the hidden angle was benchmark obsolescence. Making the SHEEP dataset to answer that was a lot of work, but also a lot of fun 🐑
🌟Final leaderboard available: helsinki-nlp.github.io/shroom/2026 📰 SHEEP dataset paper available on arXiv: arxiv.org/abs/2608.01021 Deadline for system description paper: Aug. 10 AoE. Happy writing! #SHROOM_ST #NLProc @emnlpmeeting.bsky.social
⏳5 days left to submit your system description paper. Hope it goes well! Note: you can safely refer to your team's name and ranking in the paper, but please keep the author as "anonymous". Platform: openreview.net/group?id=EMN... #NLProc #SHROOM_ST
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
openreview.net
Keep in mind that we are also open to “shared un-task” paper submissions from groups who either didn’t manage to submit to the official platform on time or used the dataset for different purposes! helsinki-nlp.github.io/shroom/2026 Reach out to organizers directly for more info ;)
shroom
helsinki-nlp.github.io
🌟Final leaderboard available: helsinki-nlp.github.io/shroom/2026 📰 SHEEP dataset paper available on arXiv: arxiv.org/abs/2608.01021 Deadline for system description paper: Aug. 10 AoE. Happy writing! #SHROOM_ST #NLProc @emnlpmeeting.bsky.social
shroom
helsinki-nlp.github.io
🌟The rankings are now publicly available on the submission website: shroom.pythonanywhere.com/submission/ Congrats to all winners 👏 Next step: write a short system description paper and submit in by Aug 10! openreview.net/group?id=EMN... Don't hesitate if you have any questions! #NLP #SHROOM_ST
SHROOM-Visions
shroom.pythonanywhere.com
🗓️ 3 days left to submit your results! Show us how well your systems perform. You will have 10 more days to finish the description papers: - Evaluation phase ends: 7.31 - System description papers due: 8.10 openreview.net/group?id=EMN.... #EMNLP #sharedtask #SHROOM_ST
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
openreview.net
OpenReview website for system descriptions is open! openreview.net/group?id=EMN.... - Accept submissions starts: July 24th - Deadline of submission: August 10th - Follow the ACL template Join our mailing list for updates! groups.google.com/g/shroom-vis... #NLProc #sharedtask #emnlp2026
EMNLP 2026 Workshop SHROOM-Visions
Welcome to the OpenReview homepage for EMNLP 2026 Workshop SHROOM-Visions
openreview.net
Second CFP: SHROOM-Visions Shared Task Identify and classify hallucination spans in image-grounded outputs across 4 languages (ZH, EN, FR, IT)! ✨20K annotated examples 📍 Co-located with UncertaiNLP @emnlpmeeting.bsky.social ⏰ Evaluation ends July 31 More info: helsinki-nlp.github.io/shroom/2026
shroom
helsinki-nlp.github.io
Apparently ACL is absolutely loaded with mushrooms, and our organizers seem way too enthusiastic about them 🙈 Can someone keep an eye on these guys, plz? We’ve got a shared task to finish for EMNLP before they disappear into the forest. 😳🍄 #SHROOM_ST #NLP @emnlpmeeting.bsky.social
Some of our organizers @linguistickus.bsky.social and Aman are @aclmeeting.bsky.social this week. Don’t be shy—reach out if you have any questions, or even just to say hi! 👋
Some of our organizers @linguistickus.bsky.social and Aman are @aclmeeting.bsky.social this week. Don’t be shy—reach out if you have any questions, or even just to say hi! 👋
⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/participant_kit.shroom_visions.zip The kit contains a format checker, the scoring program, a constant-baseline, and a more involved setup for more realistic system. #sharedtask #hallucination @emnlpmeeting.bsky.social
⚙️ Hi SHROOMers! Participant kit is available : a3s.fi/mickusti-2007780-pub/participant_kit.shroom_visions.zip The kit contains a format checker, the scoring program, a constant-baseline, and a more involved setup for more realistic system. #sharedtask #hallucination @emnlpmeeting.bsky.social
a3s.fi
*SHROOM is on Bluesky 🦋! This year we are going multimodal: check out SHROOM-visions 2026, collocated at UnicertaiNLP @emnlpmeeting.bsky.social helsinki-nlp.github.io/shroom/2026 #sharedtask #NLP #SHROOM_ST #hallucination #emnlp2026
shroom
helsinki-nlp.github.io