github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/shard_utils
History
ver217 a241f61b34
[zero] Update initialize for ZeRO (#458) 
* polish code

* shard strategy receive pg in shard() / gather()

* update zero engine

* polish code
 		2022-03-18 16:18:31 +08:00
..
__init__.py add bucket tensor shard strategy 2022-03-14 14:48:32 +08:00
base_shard_strategy.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00
bucket_tensor_shard_strategy.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00
tensor_shard_strategy.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00