ViMoE: An Empirical Study of Designing Vision Mixture-of-Experts.

Mixture-of-Experts (MoE) models embody the divide-and-conquer concept and are a promising approach for increasing model capacity, demonstrating excellent scalability across multiple domains. In this paper, we integrate the MoE structure into the clas…

Preview only. Read the full abstract at the source