A Dataset for VQA on Document Images.

Evaluating Large Multimodal Models for Integrated Capabilities

AI2 Diagrams (AI2D) is a dataset of over 5000 grade school science diagrams with over 150000 rich annotations, their ground truth syntactic parses, and more than 15000 corresponding multiple choice questions.

An Advanced Diagnostic Suite for Entangled Language Hallucination & Visual Illusion in Large Vision-Language Models

A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI

MathVista is a consolidated Mathematical reasoning benchmark within Visual contexts.

A Benchmark for Question Answering about Charts with Visual and Logical Reasoning

A Benchmark for Visual Question Answering using World Knowledge.

A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoning