ColossalAI/colossalai/zero/sharded_param
Jiarui Fang de0468c7a8 [zero] zero init context (#321)
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
2022-03-11 15:50:28 +08:00
..
__init__.py [zero] yet an improved sharded param (#311) 2022-03-11 15:50:28 +08:00
sharded_param.py [zero] zero init context (#321) 2022-03-11 15:50:28 +08:00
sharded_tensor.py [zero] polish shard strategy (#310) 2022-03-11 15:50:28 +08:00