github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/init_ctx
History
Jiarui Fang de0468c7a8 [zero] zero init context (#321) 
* add zero init context

* add more flags for zero init context
fix bug of repeated converting param to ShardedParamV2

* polish code
 		2022-03-11 15:50:28 +08:00
..
__init__.py [zero] zero init context (#321) 2022-03-11 15:50:28 +08:00
init_context.py [zero] zero init context (#321) 2022-03-11 15:50:28 +08:00