ColossalAI/colossalai/zero/shard_utils
HELSON e5ea3fdeef
[gemini] add GeminiMemoryManger (#832)
* refactor StatefulTensor, tensor utilities

* add unitest for GeminiMemoryManager
2022-04-24 13:08:48 +08:00
..
__init__.py Revert "[zero] add ZeroTensorShardStrategy (#793)" (#806) 2022-04-19 14:40:02 +08:00
base_shard_strategy.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00
bucket_tensor_shard_strategy.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00
commons.py [zero] refactor shard and gather operation (#773) 2022-04-15 14:41:31 +08:00
tensor_shard_strategy.py [gemini] add GeminiMemoryManger (#832) 2022-04-24 13:08:48 +08:00