In the Last Translation Benchmark we solve both by: - collecting hard-to-translate inputs (texts, images, audios) - requiring human-readable "verification rules", which enable provable evaluation of future translations Here are some cool examples:
Patricia Schmidtova
@patuchen.bsky.social
PhD Student of NLP | Researching Semantic Accuracy of Text Generation
📢 Call for Papers: YNLG 2026 The Young Researchers in Natural Language Generation workshop is a 2d in-person event part of INLG 2026 @inlg.bsky.social in Utrecht 🇳🇱, with poster sessions, keynote talks, roundtable discussions, and a one-day hackathon. Due: August 10, 2026 ynlg-workshop.github.io
Are you tired of getting meh results from LLMs in your native language and resorting to English instead? We are too!
We are at @eamt2026.bsky.social with a large-scale stealth project called "[redacted] Translation [redacted]". Looking for contributors across all languages to challenge MTs. Talk to @patuchen.bsky.social, @sethjsa.bsky.social and me to be a coauthor!
LLMs as Span Annotators: A Comparative Study of LLMs and Humans by @zdenekkasner.cz, @zouharvi.bsky.social, @patuchen.bsky.social, @ivankartac.bsky.social, K. Onderková, @oplatek.bsky.social, Dimitra Gkatzia, @saad.me.uk , @tuetschek.bsky.social & Simone Ballocu aclanthology.org/2026.mme-mai...
We are bringing social network trends to science communication. How do you do, fellow kids? Also, your LLM does not judge you for your grammar.
How Important is ‘Perfect’ English for Machine Translation Prompts? by @patuchen.bsky.social, @niyatibafna.bsky.social, @sethjsa.bsky.social , @gianlucavico.bsky.social ,W. Kamzela, @kathaem.bsky.social & @zouharvi.bsky.social aclanthology.org/2026.finding... TL;DR: Prompt errors < prompt choice
Check out the slides from our SCAI'2025 #convsearch workshop collocated with @ijcai.org #IJCAI2025 on LLMs, retrieval & QA, recommendations, negotiations, evaluation and transparency scai.info/scai-2025 @patuchen.bsky.social @maik-froebe.bsky.social @tuetschek.bsky.social @mila-quebec.bsky.social
SCAI 2025
Online Event on Search-Oriented Conversational AI.
scai.info
Excited to announce the first-ever Workshop for Young Researchers in Natural Language Generation (YNLG), supported by @siggen.bsky.social, taking place on October 29, 2025 in Hanoi, Vietnam, co-located with INLG 2025. Call for Submissions is out now! ynlg-workshop.github.io
I'll be giving a talk on evaluating LLM-generated summaries at Ghost Day in Poland next week!
The 👉Machine Learning Prague 2025👈 is happening right now! Today, @patuchen.bsky.social and @navitas.bsky.social presented their posters on text generation with LLMs. Also, don't miss @tuetschek.bsky.social's invited talk tomorrow at 11 a.m.
Thanks to all my awesome collaborators! 👉️ Vilém @zouharvi.bsky.social 👉️ Patrícia @patuchen.bsky.social 👉️ Ivan @ivankartac.bsky.social 👉️ Kristýna Onderková 👉️ Ondřej P. @oplatek.bsky.social 👉️ Dimitra @dimitrag.bsky.social 👉️ Saad @saad.me.uk 👉️ Ondřej D. @tuetschek.bsky.social 👉️ Simone Balloccu
I am very happy to announce that myself, Simon Mille, and @patuchen.bsky.social have been elected to serve on the @siggen.bsky.social board. I want to thank the outgoing members @evanmiltenburg.bsky.social, @raquelhervas.bsky.social, and Javier González Corbelle for their service to the board.