ColossalAI/colossalai/zero/shard_utils
Jiarui Fang 59bf2dc590
[zero] initialize a stateful tensor manager (#614)
2022-04-06 16:18:49 +08:00
..
__init__.py add bucket tensor shard strategy 2022-03-14 14:48:32 +08:00
base_shard_strategy.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00
bucket_tensor_shard_strategy.py [zero] refactor model data tracing (#537) 2022-03-28 16:38:18 +08:00
commons.py [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
stateful_tensor_mgr.py [zero] initialize a stateful tensor manager (#614) 2022-04-06 16:18:49 +08:00
tensor_shard_strategy.py [refactor] memory utils (#577) 2022-04-01 09:22:33 +08:00
tensor_utils.py [refactor] memory utils (#577) 2022-04-01 09:22:33 +08:00