🧵(1/3)
🧵(1/3)
A comprehensive multimodal & multilingual benchmark for VLMs! It contains real questions from exams in different languages.
🌍 20,911 questions and 18 languages
📚 14 subjects (STEM → Humanities)
📸 55% multimodal questions
A comprehensive multimodal & multilingual benchmark for VLMs! It contains real questions from exams in different languages.
🌍 20,911 questions and 18 languages
📚 14 subjects (STEM → Humanities)
📸 55% multimodal questions
A multi-modal multi-language benchmark of authentic exams covering
🗣️ 18 languages (Bengali → Spanish)
📚 14 subjects (Humanities → STEM)
📷 55% requiring image understanding!
📌 Most VLM benchmarks are English-centric or rely on translations—missing linguistic & cultural nuance. Kaleidoscope expands in-language multilingual 🌎 & multimodal 👀 VLMs evaluation
A multi-modal multi-language benchmark of authentic exams covering
🗣️ 18 languages (Bengali → Spanish)
📚 14 subjects (Humanities → STEM)
📷 55% requiring image understanding!
👩💻 Are you an outstanding undergraduate student willing to join our research groups?
BSC offers 16 internship positions.👐Join us!
📆 Deadline to apply: 7 April
➡ bsc.es/Zyc
@upc.edu @fib.upc.edu
👩💻 Are you an outstanding undergraduate student willing to join our research groups?
BSC offers 16 internship positions.👐Join us!
📆 Deadline to apply: 7 April
➡ bsc.es/Zyc
@upc.edu @fib.upc.edu
Grounding LLM Reasoning with Knowledge Graphs
https://arxiv.org/abs/2502.13247
Grounding LLM Reasoning with Knowledge Graphs
https://arxiv.org/abs/2502.13247
🧵👇
🧵👇