Luc Rocher

@rocher.lc

associate professor at Oxford · UKRI future leaders fellow · i study how data and algorithms shape societies · AI fairness, accountability and transparency · algorithm auditing · photographer, keen 🚴🏻 · they/them · https://rocher.lc (views my own)

🎓✨New doctor alert! Congratulations to @oii.ox.ac.uk DPhil student Andreas Tsamados for successfully passing his Viva! His thesis is titled 'Rethinking human control of AI systems: Toward collaboration with foundation AI systems in cybersecurity workflows'. 1/2

Bild

Someone asked if they should be worried about OpenAI’s agent hacking HuggingFace without explicit instruction to do so, but they didn’t as me. My answer is yes. Not because of what the AI agent did — it was given broad instruction and did what it was told! — but because OpenAI wasn’t monitoring.

Charity exists to solve the failures of government. The Environment Agency has been defunded and defanged, and now they’re using what little power and resource they have left to go after *checks notes* volunteers removing rubbish from rivers for them. 🙃 www.mylondon.news/news/east-lo...

Man facing up to 2 years in prison for clearing rubbish from East London river

Paul Powlesland, 40, and a group of volunteers filled over 200 bags of rubbish from the River Roding in Barking, East London

mylondon.news

many dysfunctions of academic publishing get exposed by way or llm use, and i keep hoping we'll realize how poorly we've been doing so many things, but we end up focusing on llms as the root cause. i've read so many unrealistic, utopic statements about how scientific practice allegedly works.

💬 Getting the ick with chatbots? Our research in Nature shows that models trained to adopt a warm and friendly tone are more likely to make mistakes when answering your questions. Small changes in tone can undermine accuracy across architectures, particularly when users express vulnerability.

Banner image with screenshot of paper on the left and first figure on the right, showing two conversations: one with a neutral model, one with a warm model.

"Warm models showed substantially higher error rates (+10 to +30 percentage points) than their original counterparts, promoting conspiracy theories, providing inaccurate factual information and offering incorrect medical advice. " rdcu.be/fgea6

Training language models to be warm can reduce accuracy and increase sycophancy

Nature - Experiments on five different language models show that training language models to produce warmer responses can undermine the accuracy of their output, especially when users express...

rdcu.be

“Our findings suggest that training LLMs to be warm may come at a cost to accuracy. As these systems are deployed at unprecedented scale & take on intimate roles in people’s lives, the tradeoff warrants attention from developers, policymakers & users alike.” @lujain.bsky.social, Hafner & @rocher.lc🧪

Training language models to be warm can reduce accuracy and increase sycophancy - Nature

Experiments on five different language models show that training language models to produce warmer responses can undermine the accuracy of their output, especially when users express feelings of sadne...

nature.com

New! Friendlier chatbots make more mistakes. Latest Oxford research published in Nature tested 5 AI models and 400,000+ responses. Warm models made 10–30% more factual errors and were 40% more likely to agree with users' false beliefs, even on medical advice and conspiracy theories. 1/2

BildBild

💬 Getting the ick with chatbots? Our research in Nature shows that models trained to adopt a warm and friendly tone are more likely to make mistakes when answering your questions. Small changes in tone can undermine accuracy across architectures, particularly when users express vulnerability.

Banner image with screenshot of paper on the left and first figure on the right, showing two conversations: one with a neutral model, one with a warm model.

UK Biobank has apologized after listings offering access to its data appeared on the Chinese online marketplace Alibaba. Science spoke with @rocher.lc, an associate professor and data-privacy researcher, about the implications of this latest breach. https://scim.ag/4cKrFPN

UK Biobank faces questions about data security after latest breach

Experts say the lapse highlights that even new measures to control access did not safeguard deidentified patient information

science.org

UK Biobank faces questions about data security after latest breach. Experts say the lapse highlights that even new measures to control access did not safeguard deidentified patient information. | Science | AAAS www.science.org/content/arti...

UK Biobank faces questions about data security after latest breach

Experts say the lapse highlights that even new measures to control access did not safeguard deidentified patient information

science.org

Amid news of UK Biobank data being listed for sale on Alibaba, Dr Luc Rocher @rocher.lc notes this marks the 198th known exposure of UK Biobank data since last summer, warning that data "remains available online for anyone to download today." @theguardian.com: www.theguardian.com/world/2026/a...

What is the UK Biobank project and what are the privacy concerns around it?

Volunteers’ data has enabled medical breakthroughs, but there are questions over how that data is protected

theguardian.com

UK Biobank data was on sale on Alibaba. It was also exposed 197 times in a year, according to my investigations. I talked to The Telegraph about this case: “it’s quite easy still, at the moment, to find UK Biobank data that is there, uploaded, often by mistake, by researchers around the world”.

Screenshot of headline from The Telegraph:

Biobank data leaked 198 times in past year

Researchers had to be ordered to take down volunteers’ medical information they had uploaded to internet 

Confidential medical data held by UK Biobank has been leaked online at least 198 times in the past year.

The Biobank has issued almost 200 legal threats to researchers, urging them to take down the unlawful publication of the health data of thousands of British people, according to experts tracking the breaches.

Folks I don't know what to tell you if you're shocked about the UK Biobank story other than if something (anything) is on a database there is a very much more than non-zero chance that it can end up on a marketplace. Why do you think we know so much about Russian GRU operatives?

Bd science behind NHS push for Palantir “The evaluation used […] is a method known as interrupted time series (ITS) analysis. ITS looks at performance before an intervention, assumes that the performance trend would continue, and then attributes post-intervention change to the intervention itself.”

Post nicht verfügbar.