ColossalAI/colossalai/nn/layer/moe
HELSON e5ea3fdeef
[gemini] add GeminiMemoryManger (#832)
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
2022-04-24 13:08:48 +08:00
..
__init__.py [MOE] support PR-MOE (#488) 2022-03-22 16:48:22 +08:00
_operation.py [MOE] polish moe_env (#467) 2022-03-19 15:36:25 +08:00
experts.py [zero] adapt zero for unsharded parameters (#561) 2022-03-31 18:34:11 +08:00
layers.py polish moe docsrting (#618) 2022-04-01 16:15:36 +08:00
utils.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00