ColossalAI/colossalai/nn
Xuanlei Zhao dc003c304c
[moe] merge moe into main (#4978)
* update moe module
* support openmoe
2023-11-02 02:21:24 +00:00
..
layer [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
loss [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
lr_scheduler [hotfix] fix lr scheduler bug in torch 2.0 (#4864) 2023-10-12 14:04:24 +08:00
optimizer [test] add no master test for low level zero plugin (#4934) 2023-10-18 11:41:23 +08:00
__init__.py [legacy] move communication and nn to legacy and refactor logger (#4671) 2023-09-11 16:24:28 +08:00
init.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00