Exciting to see practical applications of MoE architecture and its impact on benchmark performance.