ColossalAI/examples/language/openmoe/benchmark
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
2023-11-02 02:21:24 +00:00
..
benchmark_cai.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_cai.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_cai_dist.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_fsdp.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
benchmark_fsdp.sh [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
hostfile.txt [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
utils.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00