ColossalAI/colossalai/moe
ver217 06db94fbc9 [moe] fix tests 2024-02-08 12:46:37 +08:00
..
__init__.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
_operation.py [moe] support mixtral (#5309) 2024-02-07 19:21:02 +08:00
checkpoint.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
experts.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
layers.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00
load_balance.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
loss.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
manager.py fix some typo (#5307) 2024-01-25 13:56:27 +08:00
routers.py [moe] fix tests 2024-02-08 12:46:37 +08:00
utils.py [moe] init mixtral impl 2024-02-07 19:21:02 +08:00