ColossalAI/examples/language/openmoe/model
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
2023-11-02 02:21:24 +00:00
..
__init__.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
convert_openmoe_ckpt.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
convert_openmoe_ckpt.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
modeling_openmoe.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
openmoe_8b_config.json [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
openmoe_base_config.json [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
openmoe_policy.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00