This work was inspired by @tomerullman.bsky.social's “illusion illusion” paradigm (arxiv.org/abs/2412.18613) where VLMs mistake illusion-like images for genuine optical illusions. In both cases, models respond to what a problem looks like rather than what it actually requires.🔮
The Illusion-Illusion: Vision Language Models See Illusions Where There are None
Illusions are entertaining, but they are also a useful diagnostic tool in cognitive science, philosophy, and neuroscience. A typical illusion shows a gap between how something "really is" and how some...
arxiv.org