@benjamintherien.bsky.social
Reposted
Continual Pre-training of MoEs: How robust is your router?
arxiv.org/abs/2503.05029
arxiv.org/abs/2503.05029
March 10, 2025 at 8:30 AM
Continual Pre-training of MoEs: How robust is your router?
arxiv.org/abs/2503.05029
arxiv.org/abs/2503.05029
Reposted
Th\'erien, Joseph, Sarwar, Panda, Das, Zhang, Rawls, Sahu, Belilovsky, Rish: Continual Pre-training of MoEs: How robust is your router? https://arxiv.org/abs/2503.05029 https://arxiv.org/pdf/2503.05029 https://arxiv.org/html/2503.05029
March 10, 2025 at 6:10 AM
Th\'erien, Joseph, Sarwar, Panda, Das, Zhang, Rawls, Sahu, Belilovsky, Rish: Continual Pre-training of MoEs: How robust is your router? https://arxiv.org/abs/2503.05029 https://arxiv.org/pdf/2503.05029 https://arxiv.org/html/2503.05029