National University of Singapore
Email: f.xue at u.nus.edu
Joint work with: Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You
Aug 21, 2023
GitHub - XueFuzhao/OpenMoE: A family of open-sourced Mixture-of-Experts (MoE) Large Language Models
OpenMoE is a project aimed at Igniting the Open-Source MoE Community! Our mission is releasing a series of open-sourced MoE Language Models.
With a small team and a monumental project, we're taking a strategic route. We're initiating the journey by sharing intermediate checkpoints. This invites contributors to join us in shaping the open-source MoE landscape together.