Sweta Agrawal
swetaagrawal.bsky.social
Sweta Agrawal
@swetaagrawal.bsky.social
Reposted by Sweta Agrawal
As neural metrics are a pillar for #MT, being extensively used for evaluation but also improving translation, we'd want them to be fair.

🚨 Our #ACL2025 paper shows they consistently, unduly favor masculine-inflected translations, or gendered forms, over neutral ones.

arxiv.org/pdf/2410.10995
July 14, 2025 at 2:00 PM
Reposted by Sweta Agrawal
📖New preprint with Eleftheria Briakou @swetaagrawal.bsky.social @mziizm.bsky.social @kocmitom.bsky.social!

arxiv.org/abs/2504.11829

🌍It reflects experiences from my personal research journey: coming from MT into multilingual LLM research I missed reliable evaluations and evaluation research…
April 17, 2025 at 10:56 AM