ColossalAI/colossalai/nn/layer/moe
HELSON 1a1d68b053
[moe] add checkpoint for moe models (#3354)
* [moe] add checkpoint for moe models

* [hotfix] fix bugs in unit test
2023-03-31 09:20:33 +08:00
..
__init__.py [moe] add checkpoint for moe models (#3354) 2023-03-31 09:20:33 +08:00
_operation.py [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
checkpoint.py [moe] add checkpoint for moe models (#3354) 2023-03-31 09:20:33 +08:00
experts.py [moe] add checkpoint for moe models (#3354) 2023-03-31 09:20:33 +08:00
layers.py [moe] add checkpoint for moe models (#3354) 2023-03-31 09:20:33 +08:00
routers.py [moe] fix moe bugs (#1633) 2022-09-23 15:33:57 +08:00
utils.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00