Interestingly, we find that simply introducing another non-English language (not necessarily in the demonstration) helps📈, by non-English prepending context-irrelevant sentences. We show that strategic multilingual exposure bridges the gap for underrepresented languages💡.

✅ Demos in mixed high-resource languages are more robust and effective than individual high-resource languages, outperforming English-only demos.
✅ This phenomenon is generalizable across models (Llama3, GPT-4o) & tasks (math, commonsense, verbal).

Key Takeaways
✅ In-context Demonstrations in non-Latin high-resource languages (e.g., Chinese, Japanese) improves LLM performance across low-resource languages, more effectively than English-only demos.

How can we bridge LLMs' multilingual performance for low-resource languages by prompting strategies 🌍? Our latest work (w/ @fredashi.bsky.social and Andrew Xue @uwaterloo.ca) systematically analyzes various strategies of Multilingual In-Context Learning.