Jan Clusmann

@janclusmann.bsky.social

Clinician Scientist, Clinical AI Researcher, LLM Enthusiast, Climate Advocate

Finally out, in NEJM AI! Everyday labels and watermarks can override medical knowledge of vision language models, just by their presence. Was a lot of fun to work on this with @twittlabs.bsky.social , @jnkt.bsky.social and many others

Sebastian Foersch@twittlabs.bsky.social · last yr.

Excited to share our new publication in @ai.nejm.org „Incidental Prompt Injections on Vision-Language Models in Real-Life Histopathology“. Important work together with our amazing colleagues @janclusmann.bsky.social @jnkt.bsky.social @markuseckstein3.bsky.social et al. ai.nejm.org/stoken/defau...

So happy to share this: secret instructions hidden in images can terribly alter the output of VLMs to create misdiagnosis. Models have different susceptibility, though, with Claude3.5 apparently being much better aligned to ethical outputs than GPT4o. #aisafety #LLMs #VLMs

Jakob Nikolas Kather@jnkt.bsky.social · 2y ago

Very happy to share our latest paper, led by Jan Clusmann: Prompt injection attacks on vision language models in oncology. We show how VLMs in healthcare can be easily hacked and prompted to create harmful output. www.nature.com/articles/s41...