NLPnorth

@nlpnorth.bsky.social

#NLProc research group @itu.dk (Copenhagen, Denmark) 🔗 nlpnorth.github.io

AI can now answer questions about video content, transforming how people consume information on the Web. An experiment with 900+ participants found that AI improves speed and accuracy of retrieval BUT, users become overreliant on AI answers, accepting wrong answers without any loss of confidence.

A two barplots side by side.The left plot shows accuracy of information retrieval (y-axis, ranging from 0 to 100%) across three conditions (No AI, AI, and AI providing wrong answers). The right plot shows self-reported confidence in the answer correctness (y-axis, ranging from 0 to 5) across the same three conditions. Across the two plots, each condition contains two bars: one for users who watched the relevant segment of the video containing the answer to a question, and one for users who did NOT watch the segment. The plot conveys the following messages. 1) In the "No AI" condition, people who did not watch the video provide far less accurate responses. 2) In the "AI" condition, accuracy is high regardless of whether people watched the video or not. 3) in the "AI providing wrong answer" condition, accuracy drops to the minimum values for people who did not check the video. 4) Self-reported confidence in the answers is always high across all conditions, with just a tiny difference between the watched vs. non-watched scenarios

LLMs are reshaping how we process information, now even processing videos for us. In a study with 900+ participants, we found AI boosts efficiency and accuracy, but also drives overreliance. So the real question: how much of our access to information are we willing to outsource to LLMs?

Luca Maria Aiello@lajello.bsky.social · 6mo ago

AI can now answer questions about video content, transforming how people consume information on the Web. An experiment with 900+ participants found that AI improves speed and accuracy of retrieval BUT, users become overreliant on AI answers, accepting wrong answers without any loss of confidence.

A two barplots side by side.The left plot shows accuracy of information retrieval (y-axis, ranging from 0 to 100%) across three conditions (No AI, AI, and AI providing wrong answers). The right plot shows self-reported confidence in the answer correctness (y-axis, ranging from 0 to 5) across the same three conditions. Across the two plots, each condition contains two bars: one for users who watched the relevant segment of the video containing the answer to a question, and one for users who did NOT watch the segment. The plot conveys the following messages. 1) In the "No AI" condition, people who did not watch the video provide far less accurate responses. 2) In the "AI" condition, accuracy is high regardless of whether people watched the video or not. 3) in the "AI providing wrong answer" condition, accuracy drops to the minimum values for people who did not check the video. 4) Self-reported confidence in the answers is always high across all conditions, with just a tiny difference between the watched vs. non-watched scenarios

Congratulations to @chrha.bsky.social for his newly founded project "Conveying Caution & Confidence: Quantification and Communication of Uncertainty in Large Language Models" 🥳 #NLProc

IT-Universitetet i København@itu.dk · 10mo ago

Hvor godt kan du egentlig stole på det der svar fra ChatGPT..? 🤔 I et nyt projekt vil ITU-lektor @chrha.bsky.social undersøge, hvordan store sprogmodeller bedre kan kommunikere usikkerhed til brugerne. Projektet har netop modtaget en DFF-bevilling på 7,18 millioner kr. 🙏 👉 itu.dk/Om-ITU/Press...

🔍 Stiamo studiando come l'AI viene usata in Italia e per farlo abbiamo costruito un sondaggio! 👉 bit.ly/sondaggio_ai... (è anonimo, richiede ~10 minuti, e se partecipi o lo fai girare ci aiuti un sacco🙏) Ci interessa anche raggiungere persone che non si occupano e non sono esperte di AI!

Qualtrics Survey | Qualtrics Experience Management

The most powerful, simple and trusted way to gather experience data. Start your journey to experience management and try a free account today.

bit.ly

📢 New #ACL2025 Findings preprint from @brtrm.bsky.social about the perspectives on 'intelligence' in the research community! A survey of 300+ researchers shows that most don’t view current NLP systems as intelligent and only few see building intelligent systems as a research goal. #NLProc @itu.dk

Bertram Højer@brtrm.bsky.social · last yr.

Our survey paper "Research Community Perspectives on 'Intelligence' and Large Language Models" has been accepted to the ACL Findings 2025 - and I'll be in Vienna to present the work in July! arxiv.org/abs/2505.20959

📢 New #ACL2025 preprint by our postdoc @elisabassignana.bsky.social about the impact of socioeconomic status (SES) on the adoption and usage of language technologies! A first step for better understanding the AI Gap across SES and develop more inclusive language technologies ⚖️🤖 #NLProc @itu.dk

Elisa Bassignana@elisabassignana.bsky.social · last yr.

🚨 New paper accepted at #ACL2025 Main conference! 🙌 "The AI Gap: How Socioeconomic Status Affects Language Technology Interactions" w/ @amandacurry.bsky.social & @dirkhovy.bsky.social Very happy for this first collab with @milanlp.bsky.social 🤝 🔗 lnkd.in/dtsH3gaX 🤗 lnkd.in/d7diuBJh 🧵👇 #ACL2025

Congratulations to Dr. Marija Stepanović for defending her thesis "Phonetic Vowel Representation for Cross-Lingual Automatic Speech Recognition"! Well deserved 🎓🎉

BildBild

Do researchers in AI related fields believe that state-of-the-art language models are intelligent? And how do we even define intelligence? If you haven't yet responded consider taking part in our survey. We'd love to hear your take! Details and link in original post👇 !

Bertram Højer@brtrm.bsky.social · 2y ago

What do YOU mean by "intelligence", and does ChatGPT fit your definition? We collected the major criteria used in CogSci and other fields, and designed a survey to find out! Access link: www.survey-xact.dk/collect Code: 4S7V-SN4M-S536 Time: 5-10 mins

From Jan 1st we will join forces with @nerdsitu.bsky.social, ML and Audio-Visual Computing groups in the new Data Science section @itukbh.bsky.social 🤖 Looking forward to the great times ahead!

NERDS@nerdsitu.bsky.social · 2y ago

And us NERDS will be a large research group within the new section, together with our friends from NLP @nlpnorth.bsky.social, Machine Learning, and Audio-Visual Computing. Great group of people + great head = great times ahead!