AMVICC: A Novel Benchmark for Cross-Modal Failure Mode Profiling for VLMs and IGMs
We investigate visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image tasks, enabling cross-modal evaluation of visual understanding. Despite rapid growth in machine...