Dhrumil Mehta

@dmil.bsky.social

Data Journalism Prof. @ Columbia University and Deputy Director of Tow Center for Digital Journalism.

Can AI tools fact-check images? The Tow Center tested 10 images, asking AI tools to: 𝗰𝗼𝗻𝗳𝗶𝗿𝗺 𝘄𝗵𝗲𝘁𝗵𝗲𝗿 𝗲𝗮𝗰𝗵 𝗶𝗺𝗮𝗴𝗲 𝗶𝘀 𝗿𝗲𝗮𝗹 and identify its 𝗹𝗼𝗰𝗮𝘁𝗶𝗼𝗻, 𝗱𝗮𝘁𝗲, and 𝘀𝗼𝘂𝗿𝗰𝗲. Results were...well, there's a lot of red on this chart. Read the research here: www.cjr.org/tow_center/w...

Bild

Using AI search tools for research? Tow Center asked 8 AI search tools to find the source of excerpts from news articles (something Google search does pretty well). They often cited the wrong sources with confidence. Find @aisvarya17.bsky.social at #NICAR25 to hear more. 🧵Thread w/ findings below👇

klaudia jaźwińska@klaudia.bsky.social · last yr.

We found that: 1️⃣ Chatbots were generally bad at declining to answer questions they couldn’t answer accurately, offering incorrect or speculative answers instead.

Graph title: "Generative search tools were often confidently wrong in our study"
Subtitle: "The Tow Center asked eight generative search tools to identify the source article, the publication and URL for 200 excerpts extracted from news articles by 20 publishers. Each square represents the citation behavior of a response."