Danielle Bitterman MD
@daniellebitterman.bsky.social
Leading AI for Clinical Trials at AstraZeneca | Physician | Previously Harvard Med & Mass General Brigham
As I shared in the NYT, models often see the data but fail to weigh it like a physician, drifting toward generic "average patient" responses. Context window ≠ Clinical reasoning. www.nytimes.com/2025/12/03/w...
Kashmir Hill@kashhill.bsky.social · 8mo agoDr. ChatGPT is learning even more about people than Dr. Google did www.nytimes.com/2025/12/03/w...
“‘Just because you’re providing all of this information to language models,’ @daniellebitterman.bsky.social says, ‘doesn't mean they're effectively using that info in the same way that a physician would’. And once people upload this kind of data, they have limited control over how it is used.”🧪🛟
Kashmir Hill@kashhill.bsky.social · 8mo agoDr. ChatGPT is learning even more about people than Dr. Google did www.nytimes.com/2025/12/03/w...
Check out our editorial on Zazzetti et al (2025)'s paper on synthetic data generation for breast cancer, in JCO CCI! Synthetic data could help with many gaps in clinical AI research, but challenges remain especially (IMO) issues with out-of-domain generalization @shan23chen.bsky.social
Jeremy Warner, MD, MS, FAMIA, FASCO@hemoncwarner.bsky.social · 9mo agoReimagining Evidence: Artificial Intelligence Synthetic Data Generation for Cancer Research | JCO Clinical Cancer Informatics ascopubs.org/doi/full/10.... #JCOCCI
Super proud of @shan23chen.bsky.social for his podium presentation on his research into LLM sycophancy in the face of illogical medical queries at #AMIA25! Full paper: www.nature.com/articles/s41... Also cited yesterday in the NYT! www.nytimes.com/2025/11/16/w...
LLMs tend to prioritize helpfulness > reason. We show that safety-aware, compute-efficient fine-tuning helps models reason more critically in healthcare domain, and generalizes to improved safety alignment across other domains. www.nature.com/articles/s41... @shan23chen.bsky.social
When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior - npj Digital Medicine
npj Digital Medicine - When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior
nature.com
An overemphasis on helpfulness makes LLMs vulnerable. Research shows models will comply with illogical medical requests, generating false information. This sycophantic tendency can be corrected with specific prompting and fine-tuning. #MedSky #MedAI #MLSky
When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior - npj Digital Medicine
npj Digital Medicine - When helpfulness backfires: LLMs and the risk of false medical information due to sycophantic behavior
nature.com
Mass General physician-scientist @daniellebitterman.bsky.social discusses how AI assists the clinical data pipeline leading to better treatments for patients. Listen to unNatural Selection & register for #WMIF2025 at the link in bio to hear more : www.unnaturalselection.net/podcast/s1e19 #MedTech
Clinical Reporting: Mass General — unNatural Selection
Signals Over Noise: Cleaning Up Cancer Trial Data
unnaturalselection.net
Our paper on multilingual reasoning is accepted to Findings of #EMNLP2025! 🎉 (OA: 3/3/3.5/4) We show SOTA LMs struggle with reasoning in non-English languages; prompt-hack & post-training improve alignment but trade off accuracy. 📄 arxiv.org/abs/2505.22888 See you in Suzhou! #EMNLP
When Models Reason in Your Language: Controlling Thinking Trace Language Comes at the Cost of Accuracy
Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, their ability to think in other languages is less studied. This capability ...
arxiv.org
Jirui Qi@jiruiqi.bsky.social · last yr.[1/]💡New Paper Large reasoning models (LRMs) are strong in English — but how well do they reason in your language? Our latest work uncovers their limitation and a clear trade-off: Controlling Thinking Trace Language Comes at the Cost of Accuracy 📄Link: arxiv.org/abs/2505.22888
Are you driven to use AI to transform patient outcomes in oncology? My lab in the AI in Medicine Program (Mass General Brigham, Harvard Medical School) is seeking Postdoctoral Fellows to pioneer applications of AI—especially LLMs—in cancer care. More here: www.linkedin.com/posts/daniel...
🚀 Join Us at the Forefront of AI & Cancer Care | Danielle Bitterman
🚀 Join Us at the Forefront of AI & Cancer Care Are you driven to use cutting-edge AI to transform patient outcomes in oncology? My lab within the AI in Medicine Program (Mass General Brigham, Har...
linkedin.com
Reliability of Large Language Model Knowledge Across Brand and Generic Cancer Drug Names | JCO Clinical Cancer Informatics ascopubs.org/doi/abs/10.1... #JCOCCI @daniellebitterman.bsky.social
Reliability of Large Language Model Knowledge Across Brand and Generic Cancer Drug Names | JCO Clinical Cancer Informatics
PURPOSETo evaluate the performance and consistency of large language models (LLMs) across brand and generic oncology drug names in various clinical tasks, addressing concerns about potential fluctuati...
ascopubs.org
Does your LRM reason in your language? Check out new preprint led by ✨ @jiruiqi.bsky.social & @shan23chen.bsky.social. Implications for safety/human oversight & accuracy!
Jirui Qi@jiruiqi.bsky.social · last yr.[1/]💡New Paper Large reasoning models (LRMs) are strong in English — but how well do they reason in your language? Our latest work uncovers their limitation and a clear trade-off: Controlling Thinking Trace Language Comes at the Cost of Accuracy 📄Link: arxiv.org/abs/2505.22888
Agents are all the rage and we need to track their abilities in the medical domain. Enter MedBrowseComp, the 1st benchmark to assess agents' abilities to reason, navigate the web, and search for verifiable med info! Preprint: arxiv.org/abs/2505.14963 Site: moreirap12.github.io/mbc-browse-a...
I’m thrilled to be in San Francisco for @statnews.com's Breakthrough West Summit! I’ll be bringing my firsthand perspective as a physician-scientist to speak about how AI is transforming cancer care, alongside leaders in the field. Let's connect if you're here! #STATBreakthroughSummitWest
AI in Cancer Care Artificial intelligence has the potential to upend oncology, changing everything from diagnosis to treatment options. Get a wide-ranging view of how the use of technology could play out over the next few years. Moderated by @angusrohan.bsky.social #STATBreakthrough
Exciting news: we are organizing a shared task – 2nd edition of the Chemotherapy Treatment Timelines Extraction from the Clinical Narrative (text mining task) -- collocated with the Clinical NLP Workshop. Do LLMs solve the task? Check out bit.ly/ChemoTimelin...
ChemoTimelines 2025
Treatment regimens are key details in understanding the effects of genetic, epigenetic, and other factors on tumor behavior and responsiveness. As precision oncology progresses, insights into the fine...
bit.ly
A pie graph worth keeping in mind as the NIH budget plummets jamanetwork.com/journals/jam... for 356 new FDA drugs approved
Conference and professional societies: PLEASE make hybrid options available for attendees and presenters at your conferences so that scientists from HHS-funded agencies can attend. These are unmissable opportunities to promote all the great intramural science and scientists from our government.
My Perspective in @NEJM_AI. AI could distort clinical decision-making in ways that prioritize profit over patient care. Oversight & regulation must go beyond performance metrics alone to address hidden commercial forces that could shape decision support. ai.nejm.org/doi/full/10....
Unseen Commercial Forces Could Undermine Artificial Intelligence Decision Support
Artificial intelligence (AI) is poised to transform health care, yet without robust safeguards, unseen commercial interests could distort care by prioritizing profit over patient well-being. The ph...
ai.nejm.org
My opinion as an actual NIH-funded researcher (unlike Vinay) at ucsf: his lies about how NIH dollars are used reflect a complete lack of understanding of how research is performed, a lack of respect for research, and are harmful to the entire biomedical research enterprise #grifter
Ryan Marino, MD@ryanmarino.bsky.social · last yr.“Dr. Vinay Prasad, a Professor of Epidemiology and Biostatistics and Medicine at the University of California, San Francisco, praised the White House’s NIH's announcement.” Wonder how any actual researchers at UCSF feel to have a fascist weasel in their ranks selling them out?
Budgeting for the next year of my grants and they will all need to be rescoped, even before the 15% IDC rate. NCI funding at 83% for new awards and another 10% reduction for renewals (current state). Essentially, we are getting 50% of what we asked for...how is this sustainable? @carlbergstrom.com
As a cancer doctor I see every day how NIH-funded clinical trials save lives and has made the U.S. a leader in medical innovation. Here's one example: In the 1970s, childhood cancer survival was only 58%. Today it is 85%, largely thanks to NIH/NCI funding of Children's Oncology Group trials.
Congressional delegation outside USAID now: “We are here to shed a light on a crime unfolding before our eyes.”
Senator Andy Kim just went to the USAID building, talked to the security guard there to confirm employees are being barred entry, and then did a press gaggle right there in front to call it out. This is doing something. This is making an effort on messaging. Other Democratic lawmakers: take notes.
Gay? Lesbian? Trans? Intersex? NYC Health has health information for everybody. 🏳️🌈🏳️⚧️
LGBTQ+ Health - NYC Health
nyc.gov
LLM attachment styles: Secure - Claude, Anxious - DeepSeekR1/o1, Avoidant - Gemini Am I wrong?
In addition to the research funded by the NIH, I am grateful and indebted to the dedicated NIH scientists & staff. Their work advances breakthroughs, scientific careers, and improves & saves lives across the U.S
Also applies broadly to treating trainees/junior faculty kindly and collaboratively.
Dan Goldstein@dggoldst.bsky.social · 2y agoProfessors, don't be mean to job candidates, they remember it the rest of their lives. Source: remembered it the rest of my life.
Love this paper, thanks for this contribution @roxanadaneshjou.bsky.social and @rajpurkar.bsky.social. This is the way to start to understand how LLMs can and should perform for diagnostics - clinical vignettes don't reflect real world medical practice.
Roxana Daneshjou, MD, PhD@roxanadaneshjou.bsky.social · 2y agoHow do LLMs really perform in diagnosis? There are claims of superhuman AI performance on clinical vignettes, which have much of the relevant information included. That's not how medicine works. That’s why @rajpurkar.bsky.social and I worked on CRAFT-MD: www.nature.com/articles/s41...
