Angelika Romanou
banner
agromanou.bsky.social
Angelika Romanou
@agromanou.bsky.social
PhD candidate at EPFL doing research in #NLProc
👩🏻‍💻 https://agromanou.github.io/
To build INCLUDE, we collected ~200K MCQ data from 44 languages and 58 knowledge domains, collected from local sources in 52 countries, representing a rich array of cultural and regional knowledge.
December 2, 2024 at 3:53 PM
🤔 Why is regional knowledge so important?

Users expect #LLMs to know information relevant to their environments— customs, culture, etc.
To be relevant & relatable, LLMs need to know these nuances. It's not just global knowledge; it's about meeting user needs where they are.
December 2, 2024 at 3:53 PM
🚀 Introducing INCLUDE 🌍: A multilingual LLM evaluation benchmark spanning 44 languages!

Contains *newly-collected* data, prioritizing *regional knowledge*.
Setting the stage for truly global AI evaluation.
Ready to see how your model measures up?
#AI #Multilingual #LLM #NLProc
December 2, 2024 at 3:53 PM