Kellie Owens

@kellieowens.bsky.social

Assistant Professor, Medical Ethics, NYU Grossman School of Medicine. Politics and Ethics of AI, Genomics, and Health Information Technologies.

@kellieowens.bsky.social Alison Bateman-House, and I on whether AI technologies "will expand opportunities for historically overlooked patients or further concentrate attention on those already represented within existing data systems." www.tandfonline.com/doi/full/10....

Ethical and Epistemic Considerations for the Use of Artificial Intelligence in Ultra-Rare Disease Clinical Trials

Published in The American Journal of Bioethics (Vol. 26, No. 8, 2026)

tandfonline.com

New from me and @kellieowens.bsky.social: we argue that the practice of maintaining AI models in healthcare exists in a "responsibility vacuum," resulting in the emergence of creative forms of invisible labor to monitor and repair technical systems bmchealthservres.biomedcentral.com/articles/10....

Managing a “responsibility vacuum” in AI monitoring and governance in healthcare: a qualitative study - BMC Health Services Research

Background Despite the increasing implementation of artificial intelligence (AI) and machine learning (ML) technologies in healthcare, their long-term safety, effectiveness, and equity remain compromised by a lack of sustained oversight. This study explores the phenomenon of a “responsibility vacuum” in AI governance, wherein maintenance and monitoring tasks are poorly defined, inconsistently performed, and undervalued across healthcare systems. Methods We conducted semi-structured interviews with 21 experts involved in AI implementation in healthcare, including clinicians, clinical informaticists, computer scientists, and legal/policy professionals. Participants were recruited through purposive and snowball sampling. Interviews were transcribed, coded, and analyzed using abductive qualitative methods to identify themes related to maintenance practices, institutional incentives, and responsibility attribution. Results Participants widely recognized that AI models degrade over time due to factors such as data drift, changes in clinical practice, and poor generalizability. However, monitoring practices remain ad hoc and fragmented, with few institutions investing in structured oversight infrastructure. This “responsibility vacuum” is perpetuated by institutional incentives favoring rapid innovation and strategic ignorance of AI failures. Despite these challenges, some participants described grassroots efforts to monitor and maintain AI systems, drawing inspiration from fields such as radiology, laboratory medicine, and transportation safety. Conclusions Our findings suggest that institutional and cultural forces in healthcare deprioritize the maintenance of AI tools, creating a governance gap that may lead to patient harm and inequitable outcomes. Addressing this responsibility vacuum will require formalized accountability structures, interdisciplinary collaboration, and policy reforms that center long-term safety and equity. Without such changes, AI/ML technologies designed to improve patient health may introduce new forms of harm, ultimately eroding trust in AI and machine learning for healthcare.

bmchealthservres.biomedcentral.com