:page_facing_up: Paper to appear at ICLR 2024: Flan-MoE (instruction tuning + Mixture-of-Experts) :tada: