Interestingly, we find that simply introducing another non-English language (not necessarily in the demonstration) helps📈, by non-English prepending context-irrelevant sentences. We show that strategic multilingual exposure bridges the gap for underrepresented languages💡.

✅ Demos in mixed high-resource languages are more robust and effective than individual high-resource languages, outperforming English-only demos.
✅ This phenomenon is generalizable across models (Llama3, GPT-4o) & tasks (math, commonsense, verbal).

🚀New Paper🚀 Systematic Analysis of Multilingual In-Context Learning
📄 arxiv.org/pdf/2502.11364
Multilingual LLMs like Llama3.1/Qwen2.5 have shown English-rivalling performance on high-resource languages, while they often significantly underperform on low-resource languages.
#NLP #Multilingual #LLM