UKP Lab

@ukplab.bsky.social

The Ubiquitous Knowledge Processing Lab researches Natural Language Processing (#NLProc) with a strong emphasis on Large Language Models, Conversational AI & Question Answering | @cs-tudarmstadt.bsky.social ยท @TUDa.bsky.social https://www.ukp.tu-darmstadt

๐Ÿ† ๐—•๐—ฒ๐˜€๐˜ ๐—ฃ๐—ฎ๐—ฝ๐—ฒ๐—ฟ ๐—”๐˜„๐—ฎ๐—ฟ๐—ฑ ๐—ฎ๐˜ ๐—ฆ๐—ฒ๐—บ๐—˜๐˜ƒ๐—ฎ๐—น-๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ ๐—ฆ๐—ต๐—ฎ๐—ฟ๐—ฒ๐—ฑ ๐—ง๐—ฎ๐˜€๐—ธ ๐Ÿฎ! We're proud to share that work from UKP Lab has received the ๐—•๐—ฒ๐˜€๐˜ ๐—ฃ๐—ฎ๐—ฝ๐—ฒ๐—ฟ ๐—”๐˜„๐—ฎ๐—ฟ๐—ฑ ๐—ผ๐—ณ ๐—ฆ๐—ฒ๐—บ๐—˜๐˜ƒ๐—ฎ๐—น-๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ ๐—ฆ๐—ต๐—ฎ๐—ฟ๐—ฒ๐—ฑ ๐—ง๐—ฎ๐˜€๐—ธ ๐Ÿฎ, recognizing the scientific contribution behind a system that also topped the leaderboard with ๐Ÿญ๐˜€๐˜ ๐—ฝ๐—น๐—ฎ๐—ฐ๐—ฒ ๐—ถ๐—ป ๐—ฆ๐˜‚๐—ฏ๐˜๐—ฎ๐˜€๐—ธ๐˜€ ๐Ÿญ ๐—ฎ๐—ป๐—ฑ ๐Ÿฎ๐—” ๐Ÿ˜ฒ

Darya Hryhoryeva holding the SemEval-2026 Best Paper Award certificate for 'UKP_Psycontrol at SemEval-2026 Task 2: Modeling Valence and Arousal Dynamics from Text' at ACL 2026.

๐ŸŽ“ ๐—š๐˜‚๐—ฒ๐˜€๐˜ ๐—ง๐—ฎ๐—น๐—ธ ๐—ฎ๐˜ ๐˜๐—ต๐—ฒ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ We were thrilled to welcome our long-term collaborator, co-supervisor of PhD students and close colleague Prof. Preslav Nakov, Professor and Department Chair for #NLP at the #MBZUAI in Abu Dhabi, for an invited talk at the UKP Lab in #TUDarmstadt.

Preslav Nakov (left) and Iryna Gurevych (right) standing in front of a projection screen at TU Darmstadt on June 19, 2026, before Preslav Nakov's talk titled 'Human or AI? Interpretable Detection, Multilingual Perception, and the Paradox of Human-Like Text' from Mohamed bin Zayed University of Artificial Intelligence (MBZUAI).BildBild

๐—™๐—ฟ๐—ผ๐—บ ๐——๐—ฎ๐—ฟ๐—บ๐˜€๐˜๐—ฎ๐—ฑ๐˜ ๐˜๐—ผ ๐—”๐—–๐—Ÿ ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ ๐—ถ๐—ป ๐—ฆ๐—ฎ๐—ป ๐——๐—ถ๐—ฒ๐—ด๐—ผ Four UKP Lab papers got an early audience this week. @timbmg.bsky.social, @ibigoulaeva.bsky.social, and @tongletj.bsky.social presented their work at the Post-CVPR Pre-ICML Poster Session, [...]

BildBildBildBild

๐Ÿ‘‹ ๐—ก๐—ฒ๐˜„ ๐—ณ๐—ฎ๐—ฐ๐—ฒ ๐—ฎ๐˜ ๐˜๐—ต๐—ฒ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ: ๐—” ๐˜„๐—ฎ๐—ฟ๐—บ ๐˜„๐—ฒ๐—น๐—ฐ๐—ผ๐—บ๐—ฒ ๐˜๐—ผ ๐—”๐—ป๐—ฑ๐—ฟ๐—ฒ๐—ฎ! @andreamoleri.bsky.social joins us as a doctoral researcher, jointly supervised by Prof. Dr. @igurevych.bsky.social and Prof. Dr. Marcus Rohrbach.

Welcome graphic for Andrea Moleri, Doctoral researcher at UKP Lab. His portrait photo is framed in a red circle, with the UKP Lab and TU Darmstadt logos and the word "Welcome" repeated four times.

๐Ÿš€ ๐—Ÿ๐—ฎ๐˜๐—ฒ๐˜€๐˜ ๐—ก๐—Ÿ๐—ฃ๐—ฒ๐—ฒ๐—ฟ ๐—ฅ๐—ฒ๐—น๐—ฒ๐—ฎ๐˜€๐—ฒ ๐—ณ๐—ฟ๐—ผ๐—บ ๐—”๐—ฅ๐—ฅ ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ ๐—ถ๐˜€ ๐—ผ๐˜‚๐˜! Grab your Peer Review data: tudatalib.ulb.tu-darmstadt.de/handle/tudat... ๐Ÿ“Š ๐—˜๐—”๐—–๐—Ÿ ๐Ÿฎ๐Ÿฒ ๐—”๐—ฐ๐—ฐ๐—ฒ๐—ฝ๐˜๐—ฒ๐—ฑ ๐—ฃ๐—ฎ๐—ฝ๐—ฒ๐—ฟ ๐——๐—ฎ๐˜๐—ฎ: โœ… 647 papers โœ… 942 reviews โœ… 329 meta-reviews โœ… 550 papers with rebuttals

Black-and-white illustration of a person wearing a graduation cap, examining a document with a magnifying glass.Black-and-white illustration of a person wearing a graduation cap, examining a document with a magnifying glass. A robotic parrot sits on their shoulder.

๐Ÿงฎ LREC 2026 proceedings are out, and I just counted the annotation tool citations. ๐Ÿ’ก INCEpTION came out on top with 39 citations and 28 of those actually using it! โค๏ธ Massive thanks to the LREC community for choosing INCEpTION! #lrec2026 #inceptiontap #opensource #textannotation #opensource

INCEpTION @ LREC 2026

As you might know, I am the maintainer of the INCEpTION open source tool for the semantic and linguistic annotation of text documents. And the LREC conference is a good way to gauge how popular INCEpT...

linkedin.com

โœจ ๐—จ๐—ž๐—ฃ ๐——๐—ฎ๐˜† ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฒ โœจ Once a year, the entire UKP Lab comes together for a day of scientific exchange, discussion, and community building โ€“ the UKP Day. On May 28, 2026, we gathered at @tuda.bsky.social to share ideas, learn from one another, and connect with colleagues from across the field.

Bild

๐Ÿ’ป ๐—ช๐—ฒ๐—น๐—ฐ๐—ผ๐—บ๐—ฒ ๐˜๐—ผ ๐˜๐—ต๐—ฒ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ, ๐—ฃ๐—ต๐˜‚ ๐—š๐—ถ๐—ฎ ๐—›๐—ผ๐—ฎ๐—ป๐—ด! We're happy to welcome Phu Gia Hoang as a doctoral researcher at the UKP Lab. At UKP, Phu works on ๐—บ๐—ฒ๐—ฐ๐—ต๐—ฎ๐—ป๐—ถ๐˜€๐˜๐—ถ๐—ฐ ๐—ถ๐—ป๐˜๐—ฒ๐—ฟ๐—ฝ๐—ฟ๐—ฒ๐˜๐—ฎ๐—ฏ๐—ถ๐—น๐—ถ๐˜๐˜†, exploring ๐—ด๐—ฒ๐—ผ๐—บ๐—ฒ๐˜๐—ฟ๐—ถ๐—ฐ ๐—ถ๐—ป๐˜๐˜‚๐—ถ๐˜๐—ถ๐—ผ๐—ป as a lens to better understand how language models represent and process information internally.

Welcome graphic from UKP Lab at TU Darmstadt introducing Phu Gia Hoang as a new Doctoral Researcher, with his portrait next to a 'Welcome' message on a background of scattered letter tiles.

๐Ÿš€ ๐—ช๐—ฒ'๐—ฟ๐—ฒ ๐—ต๐—ถ๐—ฟ๐—ถ๐—ป๐—ด: ๐—ฃ๐—ผ๐˜€๐˜๐—ฑ๐—ผ๐—ฐ๐˜๐—ผ๐—ฟ๐—ฎ๐—น ๐—ฅ๐—ฒ๐˜€๐—ฒ๐—ฎ๐—ฟ๐—ฐ๐—ต๐—ฒ๐—ฟ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐—˜๐—ฅ๐—– ๐—”๐—ฑ๐˜ƒ๐—ฎ๐—ป๐—ฐ๐—ฒ๐—ฑ ๐—š๐—ฟ๐—ฎ๐—ป๐˜ ๐—œ๐—ป๐˜๐—ฒ๐—ฟ๐—ง๐—ฒ๐˜…๐˜ ๐—ฎ๐˜ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ, ๐—ง๐—จ ๐——๐—ฎ๐—ฟ๐—บ๐˜€๐˜๐—ฎ๐—ฑ๐˜ If you work on #LLMs that reason across complex documents, not just within them, this role is for you.

Job advertisement from UKP Lab at TU Darmstadt with the headline 'We are hiring!' for a Postdoctoral Researcher position in the ERC Advanced Grant project InterTextAI. The image shows a university building with arched entrances, a QR code for more information, the TU Darmstadt logo, and social media handles for @UKPLab.

๐ŸŒ ๐—๐—ผ๐—ถ๐—ป๐—ถ๐—ป๐—ด ๐˜๐—ต๐—ฒ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ: ๐—ช๐—ฒ๐—น๐—ฐ๐—ผ๐—บ๐—ฒ, ๐—ž๐˜‚๐—ฟ๐˜ ๐— ๐—ถ๐—ฐ๐—ฎ๐—น๐—น๐—ฒ๐—ณ! Weโ€™re glad to welcome Kurt Micallef as a new postdoctoral researcher at the UKP Lab. Kurtโ€™s previous work focused on ๐—ก๐—Ÿ๐—ฃ ๐—ณ๐—ผ๐—ฟ ๐— ๐—ฎ๐—น๐˜๐—ฒ๐˜€๐—ฒ, where he worked on low resource and cross lingual techniques, developed Maltese centric language models, [...]

Welcome graphic from the UKP Lab featuring Kurt Micallef, labeled โ€œPostdoctoral researcher.โ€ On the left is a circular portrait of a man standing outdoors at sunset. On the right, the word โ€œWELCOMEโ€ appears repeatedly in the background. Logos of the Ubiquitous Knowledge Processing Lab and Technische Universitรคt Darmstadt are included, along with social media icons and the handle @UKPLab.

๐Ÿ’ฌโžก๏ธ๐Ÿค– ๐—ง๐—ต๐—ฒ ๐—ข๐—ฟ๐—ถ๐—ด๐—ถ๐—ป ๐—ผ๐—ณ ๐˜๐—ต๐—ฒ ๐—ก๐—ฒ๐˜„ ๐—ช๐—ผ๐—ฟ๐—น๐—ฑ: ๐—›๐—ผ๐˜„ ๐—ช๐—ฒ ๐—œ๐—ป๐˜ƒ๐—ฒ๐—ป๐˜๐—ฒ๐—ฑ ๐—Ÿ๐—ฎ๐—ฟ๐—ด๐—ฒ ๐—Ÿ๐—ฎ๐—ป๐—ด๐˜‚๐—ฎ๐—ด๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—น๐˜€ At #BiennaleTecnologia in Turin, I have joined Renato Beninatto to discuss the scientific ideas that helped make todayโ€™s #LLMs possible: from decades of machine translation research to the rise of attention and the Transformer.

๐Ÿค” How can we innovate reading and writing workflows for students, educators, researchers โ€“ and at the same time make it useful to science? ๐Ÿš€ Meet ๐—–๐—”๐—ฅ๐—˜: โ€” now with a ๐—บ๐—ฎ๐—ท๐—ผ๐—ฟ ๐˜‚๐—ฝ๐—ฑ๐—ฎ๐˜๐—ฒ and ๐—ณ๐˜‚๐—น๐—น๐˜† ๐—ผ๐—ฝ๐—ฒ๐—ป ๐—ฑ๐—ฒ๐˜ƒ๐—ฒ๐—น๐—ผ๐—ฝ๐—บ๐—ฒ๐—ป๐˜ on GitHub. Check out the ๐Ÿงต below if you want to know more.

Promotional graphic announcing a โ€œMajor Releaseโ€ of CARE with the phrase โ€œOpening Dev.โ€ The word โ€œCAREโ€ is split into two blocks: โ€œCAโ€ inside a speech bubble icon and โ€œREโ€ in a yellow rectangle. The background features faint icons related to research and writing, such as books, charts, links, and documents.

๐Ÿ—“๏ธ The ARR March review deadline is approaching: April 20 AoE. Finishing up your review? Run it through REVAS, a peer review assistant that makes your suggestions more actionable, flags unsupported claims, and grounds your feedback in the paper. ๐Ÿ‘‰ revas.mbzuai.ac.ae

REVAS โ€” AI-Powered Peer Review Feedback for Academics

REVAS analyzes the weakness section of your peer review, scoring each paragraph on actionability, helpfulness, grounding, and verifiability.

revas.mbzuai.ac.ae

๐Ÿ” ๐—จ๐˜€๐—ถ๐—ป๐—ด ๐—พ๐˜‚๐—ฎ๐—ป๐˜๐—ถ๐˜‡๐—ฒ๐—ฑ ๐—Ÿ๐—Ÿ๐— ๐˜€ ๐˜๐—ผ ๐—ฏ๐—ผ๐—ผ๐˜€๐˜ ๐—ฒ๐—ณ๐—ณ๐—ถ๐—ฐ๐—ถ๐—ฒ๐—ป๐—ฐ๐˜†? ๐—ช๐—ฎ๐˜๐—ฐ๐—ต ๐˜๐—ต๐—ฒ ๐˜€๐—ผ๐—ฐ๐—ถ๐—ฎ๐—น ๐˜๐—ฟ๐—ฎ๐—ฑ๐—ฒ-๐—ผ๐—ณ๐—ณ๐˜€, ๐˜๐—ผ๐—ผ. โš ๏ธ Quantization makes LLMs cheaper and more deployable. But what does it do to fairness, toxicity, and bias? ๐Ÿ’ก The research gap: a systematic picture of how quantization affects social behavior across models and tasks.

Diagram illustrating a social bias evaluation pipeline for large language models. On the left, an LLM is transformed via a quantizer into a 4-bit quantized LLM. Both models are then evaluated within a โ€œSocial Bias Evaluation Frameworkโ€ that includes categories such as stereotype (SS, RB, WB, BBQ), toxicity (BLD, DTT), sentiment (BLD), and fairness (DE, DEG, DTF). Arrows lead to bar charts on the right labeled โ€œSocial Bias Level,โ€ comparing bias levels across models.

#EACL2026 in Rabat is in full swing โœจ From papers to hallway discussions - itโ€™s great to see our team actively contributing to this yearโ€™s #EACL conference. Say hello to this group if youโ€™re on site ๐Ÿ‘‡

Group photo of eight conference participants standing in front of an EACL 2026 backdrop in Rabat, Morocco. They wear name badges and casual to semi-formal attire, posing indoors against a banner that reads โ€œEACL 2026 Rabat, Morocco, March 24โ€“29, 2026โ€ with sponsor logos and decorative patterns.

๐ŸŽ“ ๐—š๐˜‚๐—ฒ๐˜€๐˜ ๐—ง๐—ฎ๐—น๐—ธ ๐—ฎ๐˜ ๐˜๐—ต๐—ฒ ๐—จ๐—ž๐—ฃ ๐—Ÿ๐—ฎ๐—ฏ ๐Ÿ‘‹ We were pleased to welcome Yova Kementchedjhieva, Assistant Professor at the MBZUAI (Mohamed bin Zayed University of Artificial Intelligence), for a guest talk at the UKP Lab in Darmstadt.

Promotional graphic for a guest talk featuring Prof. Yova Kementchedjhieva. A portrait of a smiling woman with curly hair, arms crossed, is framed in a red circle against a background of keyboard keys spelling โ€œUSE.โ€ Text reads โ€œProf. Yova Kementchedjhievaโ€ and โ€œMBZUAI Guest Talk.โ€ Logos of the Ubiquitous Knowledge Processing Lab and Technische Universitรคt Darmstadt appear, along with social media icons and the handle @UKPLab.

๐—”๐˜‚๐˜๐—ผ๐—บ๐—ฎ๐˜๐—ถ๐—ฐ ๐—ฟ๐—ฒ๐˜ƒ๐—ถ๐—ฒ๐˜„๐—ฒ๐—ฟ๐˜€ ๐—ฐ๐—ฎ๐—ป ๐—บ๐—ถ๐˜€๐˜€ ๐—ณ๐˜‚๐—ป๐—ฑ๐—ฎ๐—บ๐—ฒ๐—ป๐˜๐—ฎ๐—น ๐—ฟ๐—ฒ๐—ฎ๐˜€๐—ผ๐—ป๐—ถ๐—ป๐—ด ๐—ฒ๐—ฟ๐—ฟ๐—ผ๐—ฟ๐˜€. ๐Ÿ‘€ LLM-generated reviews may look convincing โ€” but how reliable are they in practice? In our recent TACL paper, we introduce a ๐—ฐ๐—ผ๐—ป๐˜๐—ฟ๐—ผ๐—น๐—น๐—ฒ๐—ฑ ๐—ฐ๐—ผ๐˜‚๐—ป๐˜๐—ฒ๐—ฟ๐—ณ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น ๐—ฒ๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ณ๐—ฟ๐—ฎ๐—บ๐—ฒ๐˜„๐—ผ๐—ฟ๐—ธ to systematically test automatic reviewers.

Schematic diagram of analyzing scientific papers. On the left, a document contains color-coded sections representing claim, conclusion, result, and method. In the center, these categories are listed, with dashed lines linking them to corresponding parts of the document. A red cross marks an incorrect linkage between a result and a section in a second document shown on the right, where one passage is highlighted. At the bottom, small robot figures are shown reviewing documents, indicating automated evaluation or peer review processes.

๐—˜๐—บ๐—ฝ๐—ฎ๐˜๐—ต๐˜† ๐—ถ๐˜€๐—ปโ€™๐˜ ๐—ฒ๐—ป๐—ผ๐˜‚๐—ด๐—ต: ๐—”๐—œ-๐—ฏ๐—ฎ๐˜€๐—ฒ๐—ฑ ๐˜๐—ต๐—ฒ๐—ฟ๐—ฎ๐—ฝ๐—ถ๐˜€๐˜๐˜€ ๐—ฐ๐—ฟ๐˜‚๐—ฐ๐—ถ๐—ฎ๐—น๐—น๐˜† ๐—ป๐—ฒ๐—ฒ๐—ฑ ๐—ฐ๐˜‚๐—น๐˜๐˜‚๐—ฟ๐—ฎ๐—น ๐—ฐ๐—ผ๐—ป๐˜๐—ฒ๐˜…๐˜! ๐Ÿค–๐Ÿซถ๐ŸŒ Millions of people worldwide lack access to mental health care. LLMs are increasingly explored as scalable tools for empathetic support, ๐—ฏ๐˜‚๐˜ they often miss ๐—ฎ ๐—ธ๐—ฒ๐˜† ๐—ฑ๐—ถ๐—บ๐—ฒ๐—ป๐˜€๐—ถ๐—ผ๐—ป: ๐—ฐ๐˜‚๐—น๐˜๐˜‚๐—ฟ๐—ฒ.

Illustration of the CultureCare framework for culturally aware emotional support in AI systems. The diagram shows a distress message from a 17-year-old in Sudan describing anger issues and stigma around therapy, with cultural signals and emotional distress highlighted. It compares responses: a detailed human response offering supportive suggestions, a generic LLM response acknowledging emotional coping, and an adapted LLM response that incorporates cultural context and suggests speaking with a trusted family member or friend.

๐Ÿ”ฅ ๐— ๐—ฒ๐˜๐—ฎ-๐—ฟ๐—ฒ๐˜ƒ๐—ถ๐—ฒ๐˜„๐—ถ๐—ป๐—ด ๐—ถ๐˜€ ๐—บ๐—ผ๐—ฟ๐—ฒ ๐˜๐—ต๐—ฎ๐—ป ๐—ฎ ๐˜€๐˜‚๐—บ๐—บ๐—ฎ๐—ฟ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป - ๐—ถ๐˜โ€™๐˜€ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป-๐—บ๐—ฎ๐—ธ๐—ถ๐—ป๐—ด. In our new paper, โ€œ๐——๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป-๐— ๐—ฎ๐—ธ๐—ถ๐—ป๐—ด ๐˜„๐—ถ๐˜๐—ต ๐——๐—ฒ๐—น๐—ถ๐—ฏ๐—ฒ๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: ๐— ๐—ฒ๐˜๐—ฎ-๐—ฟ๐—ฒ๐˜ƒ๐—ถ๐—ฒ๐˜„๐—ถ๐—ป๐—ด ๐—ฎ๐˜€ ๐—ฎ ๐——๐—ผ๐—ฐ๐˜‚๐—บ๐—ฒ๐—ป๐˜-๐—ด๐—ฟ๐—ผ๐˜‚๐—ป๐—ฑ๐—ฒ๐—ฑ ๐——๐—ถ๐—ฎ๐—น๐—ผ๐—ด๐˜‚๐—ฒโ€, we ask how AI can support meta-reviewers ๐—ถ๐—ป ๐˜๐—ต๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป ๐—ฝ๐—ฟ๐—ผ๐—ฐ๐—ฒ๐˜€๐˜€ โ€” ๐—ป๐—ผ๐˜ ๐—ท๐˜‚๐˜€๐˜ ๐—ถ๐—ป ๐˜„๐—ฟ๐—ถ๐˜๐—ถ๐—ป๐—ด ๐˜๐—ต๐—ฒ ๐—ณ๐—ถ๐—ป๐—ฎ๐—น ๐—ฟ๐—ฒ๐—ฝ๐—ผ๐—ฟ๐˜.

Diagram illustrating how AI analyzes peer review discussions. A reviewer asks whether reviewers disagree on the strengths of a paper. The system summarizes that reviewers 1 and 2 both evaluate the method but differ in their assessment, with one seeing it as well-designed and the other noting issues. Another question asks whether other reviewers consider these issues important; reviewer 3 mentions them but treats them as minor concerns. Side labels indicate steps of correlating opinions and weighting arguments.

๐Ÿค” ๐——๐—ถ๐—ฑ ๐˜†๐—ผ๐˜‚๐—ฟ ๐—Ÿ๐—Ÿ๐—  ๐—ฟ๐—ฒ๐—ฎ๐—น๐—น๐˜† ๐—ณ๐—ผ๐—ฟ๐—ด๐—ฒ๐˜ ๐˜†๐—ผ๐˜‚๐—ฟ ๐—ฝ๐—ฟ๐—ถ๐˜ƒ๐—ฎ๐˜๐—ฒ ๐—ฑ๐—ฎ๐˜๐—ฎ - ๐—ผ๐—ฟ ๐—ท๐˜‚๐˜€๐˜ ๐—ด๐—ฒ๐˜ ๐—พ๐˜‚๐—ถ๐—ฒ๐˜๐—ฒ๐—ฟ ๐—ฎ๐—ฏ๐—ผ๐˜‚๐˜ ๐—ถ๐˜? ๐Ÿง  Machine unlearning aims to remove specific training data (e.g., private info) without full retraining. But does it actually ๐—ฟ๐—ฒ๐—บ๐—ผ๐˜ƒ๐—ฒ ๐˜๐—ต๐—ฒ ๐—ธ๐—ป๐—ผ๐˜„๐—น๐—ฒ๐—ฑ๐—ด๐—ฒ ๐—ณ๐—ฟ๐—ผ๐—บ ๐˜๐—ต๐—ฒ ๐—บ๐—ผ๐—ฑ๐—ฒ๐—น?

Three-panel diagram explaining an audit method for LLM unlearning.
Panel A, โ€œLLM Unlearning,โ€ shows a trained language model and a modified โ€œunlearnedโ€ model, highlighting that output-based metrics may give a misleading sense of privacy.
Panel B, โ€œOur Audit,โ€ illustrates comparing the two models using a Venn diagram to decompose mutual information into unlearned information and residual information.
Panel C, โ€œPractical Impact,โ€ shows that residual information can correlate with vulnerability to adversarial attacks, and suggests inference-time privacy protection through abstention.

๐Ÿง ๐Ÿ”— How can we link semantically related sentences across documents - ๐™ฌ๐™ž๐™ฉ๐™ ๐™ฏ๐™š๐™ง๐™ค ๐™ก๐™–๐™—๐™š๐™ก๐™š๐™™ ๐™™๐™–๐™ฉ๐™–? Meet ๐—”๐—•๐—–๐——-๐—Ÿ๐—œ๐—ก๐—ž ๐Ÿš€

Three-step workflow diagram for evaluating retrieval approaches.
Step 1, โ€œData generation and validation,โ€ shows synthetic data being aligned with natural data across two domains: peer reviews and news.
Step 2, โ€œAutomatic evaluation,โ€ compares multiple approaches (10 retrievers and 3 LLMs) and produces a shortlist of the best-performing models.
Step 3, โ€œAssisted labeling,โ€ illustrates human annotators reviewing candidate outputs and marking them as correct or incorrect.
The final result is the selection of the best approach and the creation of labeled data.

โ€œ๐—ฌ๐—ผ๐˜‚๐—ฟ ๐—ฝ๐—ฎ๐—ฝ๐—ฒ๐—ฟ ๐—ถ๐˜€ ๐—ป๐—ผ๐˜ ๐—ป๐—ผ๐˜ƒ๐—ฒ๐—น ๐—ฒ๐—ป๐—ผ๐˜‚๐—ด๐—ต.โ€๐Ÿ™… We have all seen this infamous comment from Reviewer #2. But ๐—ต๐—ผ๐˜„ ๐—ฟ๐—ฒ๐—น๐—ถ๐—ฎ๐—ฏ๐—น๐—ฒ ๐—ถ๐˜€ ๐˜๐—ต๐—ฒ ๐—ป๐—ผ๐˜ƒ๐—ฒ๐—น๐˜๐˜† ๐—ฎ๐˜€๐˜€๐—ฒ๐˜€๐˜€๐—บ๐—ฒ๐—ป๐˜ ๐˜๐—ผ๐—ฑ๐—ฎ๐˜†?๐Ÿค”

Infographic titled โ€œThe Hidden Complexity Behind โ€˜Not Novel Enoughโ€™,โ€ explaining why novelty assessment in peer review is difficult at scale. The graphic shows a researcher surrounded by stacks of papers and question marks, illustrating uncertainty in evaluating novelty. On the left, challenges include fragmented literature, reviewer overload (14+ papers per year), and unclear novelty criteria. On the right, resulting issues include inconsistent decisions, author confusion, and weak scientific feedback. The infographic concludes that novelty assessment requires searching, comparing, and judging prior work under severe time constraints.

๐Ÿšจ Introducing ๐—š๐—ฟ๐—ถ๐˜๐—›๐—ผ๐—ฝ๐—ฝ๐—ฒ๐—ฟ, the new State-of-the-Art Multi-Hop Dense Retriever ๐Ÿฆ— Current approaches to multi-hop retrieval face critical trade-offs. ๐Ÿ”Ž Decomposition-based methods break complex queries into simpler steps, but they are computationally expensive and difficult to train end-to-end.

๐ŸŽ“ ๐——๐—ถ๐˜€๐˜€๐—ฒ๐—ฟ๐˜๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ โ€“ ๐—–๐—ฒ๐—ฐ๐—ถ๐—น๐—ถ๐—ฎ Congratulations to @ccliu.bsky.social on the successful PhD defense at the UKP Lab of @tuda.bsky.social In her thesis ๐˜Ž๐˜ฆ๐˜ฏ๐˜ฆ๐˜ณ๐˜ข๐˜ญ๐˜ช๐˜ป๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ ๐˜ข๐˜ฏ๐˜ฅ ๐˜ˆ๐˜ฅ๐˜ข๐˜ฑ๐˜ต๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ ๐˜ฐ๐˜ง ๐˜“๐˜ข๐˜ฏ๐˜จ๐˜ถ๐˜ข๐˜จ๐˜ฆ ๐˜”๐˜ฐ๐˜ฅ๐˜ฆ๐˜ญ๐˜ด ๐˜ต๐˜ฐ ๐˜“๐˜ข๐˜ฏ๐˜จ๐˜ถ๐˜ข๐˜จ๐˜ฆ๐˜ด ๐˜ข๐˜ฏ๐˜ฅ ๐˜Š๐˜ถ๐˜ญ๐˜ต๐˜ถ๐˜ณ๐˜ฆ๐˜ด, Cecilia investigates ...

Smiling person standing in a doorway wearing a handmade graduation cap decorated with stickers and photos. They hold the cap with one hand, carry a tote bag over their shoulder, and hold a smartphone in the other hand. A hallway with chairs and large windows is visible in the background.

๐ŸŽ“ ๐—”๐—œ ๐˜๐—ผ ๐˜€๐˜‚๐—ฝ๐—ฝ๐—ผ๐—ฟ๐˜ ๐—ฐ๐—ผ๐˜‚๐—ฟ๐˜€๐—ฒ ๐—ถ๐—ป๐˜€๐˜๐—ฟ๐˜‚๐—ฐ๐˜๐—ผ๐—ฟ๐˜€ ๐—ป๐—ผ๐˜ ๐˜๐—ผ ๐—ฟ๐—ฒ๐—ฝ๐—น๐—ฎ๐—ฐ๐—ฒ ๐˜๐—ต๐—ฒ๐—บ! In ๐˜„๐—ถ๐—ป๐˜๐—ฒ๐—ฟ ๐˜€๐—ฒ๐—บ๐—ฒ๐˜€๐˜๐—ฒ๐—ฟ ๐Ÿฎ๐Ÿฌ๐Ÿฎ๐Ÿฑ/๐Ÿฎ๐Ÿฒ, our AI-based system ๐—Ÿ๐—Ÿ๐— ๐—ฒ๐—ป๐˜๐—ผ๐—ฟ has supported teaching the course ๐˜๐˜ฏ๐˜ต๐˜ณ๐˜ฐ๐˜ฅ๐˜ถ๐˜ค๐˜ต๐˜ช๐˜ฐ๐˜ฏ ๐˜ต๐˜ฐ ๐˜š๐˜ค๐˜ช๐˜ฆ๐˜ฏ๐˜ต๐˜ช๐˜ง๐˜ช๐˜ค ๐˜ž๐˜ฐ๐˜ณ๐˜ฌ at @cs-tudarmstadt.bsky.social

University classroom scene in which students sit at desks while a lecturer presents at the front. One student raises a hand while interacting with a large transparent digital interface showing a document and evaluation tools for academic writing, illustrating AI-assisted feedback and assessment during a seminar.

Thanks a lot to everyone for the support, guidance, mentoring, collaboration, and great moments over the past years! ๐Ÿ™ Without you, this journey wouldn't have been such a pleasure โ€” and now excited to see what the future brings! ๐Ÿš€

UKP Lab@ukplab.bsky.social ยท 5mo ago

๐ŸŽ“ ๐—ฃ๐—ต๐—— ๐—ฑ๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ฐ๐—ผ๐—ป๐—ด๐—ฟ๐—ฎ๐˜๐˜‚๐—น๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐˜€ ๐˜๐—ผ ๐—”๐—ป๐—ฑ๐—ฟ๐—ฒ๐—ฎ๐˜€ ๐—ช๐—ฎ๐—น๐—ฑ๐—ถ๐˜€! Congratulations to @tresiwald.bsky.social on the successful defense of his dissertation โ€œ๐˜ˆ๐˜ฏ ๐˜๐˜ฏ๐˜ต๐˜ฆ๐˜จ๐˜ณ๐˜ข๐˜ญ ๐˜๐˜ช๐˜ฆ๐˜ธ ๐˜ฐ๐˜ฏ ๐˜ต๐˜ฉ๐˜ฆ ๐˜™๐˜ฆ๐˜ญ๐˜ช๐˜ข๐˜ฃ๐˜ช๐˜ญ๐˜ช๐˜ต๐˜บ ๐˜ฐ๐˜ง ๐˜“๐˜ข๐˜ฏ๐˜จ๐˜ถ๐˜ข๐˜จ๐˜ฆ ๐˜”๐˜ฐ๐˜ฅ๐˜ฆ๐˜ญ๐˜ด ๐˜ง๐˜ฐ๐˜ณ ๐˜Š๐˜ฐ๐˜ฎ๐˜ฑ๐˜ถ๐˜ต๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ๐˜ข๐˜ญ ๐˜ˆ๐˜ณ๐˜จ๐˜ถ๐˜ฎ๐˜ฆ๐˜ฏ๐˜ต๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏโ€, held at Technische Universitรคt Darmstadt on February 17th, 2026.

๐Ÿ“ฃ๐Ÿงช ๐—ก๐—ฒ๐˜„ ๐—ฟ๐—ฒ๐˜€๐˜‚๐—น๐˜๐˜€: ๐—˜๐˜ƒ๐—ฎ๐—น๐˜‚๐—ฎ๐˜๐—ถ๐—ป๐—ด ๐—ฆ๐—ฐ๐—ถ๐—ฒ๐—ป๐˜๐—ถ๐—ณ๐—ถ๐—ฐ ๐—ช๐—ฟ๐—ถ๐˜๐—ถ๐—ป๐—ด ๐˜„๐—ถ๐˜๐—ต ๐—˜๐˜…๐—ฝ๐—ฒ๐—ฟ๐˜ ๐—ฃ๐—ฟ๐—ฒ๐—ณ๐—ฒ๐—ฟ๐—ฒ๐—ป๐—ฐ๐—ฒ๐˜€ ๐Ÿ‘‰ Today we are presenting our first two papers that build on HAI-Co2, our recent position paper on human-ai text co-construction in expert domains:

Poster titled โ€œReward Modeling for Scientific Writing Evaluation & Expert Preference Based Evaluation of Automated Related Work Generation,โ€ with authors Furkan Sahinuรง, Subhabrata Dutta, and Iryna Gurevych. The graphic illustrates a workflow: cited papers are used by an author to create a gold standard related work section and evaluation criteria, while AI generators produce draft related work sections. An LLM-supported evaluation system ranks outputs based on expert preferences, with feedback loops to improve generation quality.

๐ŸŽ“ ๐—ฃ๐—ต๐—— ๐—ฑ๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ฐ๐—ผ๐—ป๐—ด๐—ฟ๐—ฎ๐˜๐˜‚๐—น๐—ฎ๐˜๐—ถ๐—ผ๐—ป๐˜€ ๐˜๐—ผ ๐—”๐—ป๐—ฑ๐—ฟ๐—ฒ๐—ฎ๐˜€ ๐—ช๐—ฎ๐—น๐—ฑ๐—ถ๐˜€! Congratulations to @tresiwald.bsky.social on the successful defense of his dissertation โ€œ๐˜ˆ๐˜ฏ ๐˜๐˜ฏ๐˜ต๐˜ฆ๐˜จ๐˜ณ๐˜ข๐˜ญ ๐˜๐˜ช๐˜ฆ๐˜ธ ๐˜ฐ๐˜ฏ ๐˜ต๐˜ฉ๐˜ฆ ๐˜™๐˜ฆ๐˜ญ๐˜ช๐˜ข๐˜ฃ๐˜ช๐˜ญ๐˜ช๐˜ต๐˜บ ๐˜ฐ๐˜ง ๐˜“๐˜ข๐˜ฏ๐˜จ๐˜ถ๐˜ข๐˜จ๐˜ฆ ๐˜”๐˜ฐ๐˜ฅ๐˜ฆ๐˜ญ๐˜ด ๐˜ง๐˜ฐ๐˜ณ ๐˜Š๐˜ฐ๐˜ฎ๐˜ฑ๐˜ถ๐˜ต๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏ๐˜ข๐˜ญ ๐˜ˆ๐˜ณ๐˜จ๐˜ถ๐˜ฎ๐˜ฆ๐˜ฏ๐˜ต๐˜ข๐˜ต๐˜ช๐˜ฐ๐˜ฏโ€, held at Technische Universitรคt Darmstadt on February 17th, 2026.

BildBildBildBild