Jiarui Fang 44e4891f57 [zero] able to place params on cpu after zero init context (#365) ... * place params on cpu after zero init context * polish code		2022-03-11 15:50:28 +08:00
..
init_ctx	[zero] able to place params on cpu after zero init context (#365)	2022-03-11 15:50:28 +08:00
shard_utils	[zero] able to place params on cpu after zero init context (#365)	2022-03-11 15:50:28 +08:00
sharded_model	fix grad shape	2022-03-11 15:50:28 +08:00
sharded_optim	[zero] update sharded optim v2 (#334)	2022-03-11 15:50:28 +08:00
sharded_param	[zero] able to place params on cpu after zero init context (#365)	2022-03-11 15:50:28 +08:00
__init__.py	added buffer sync to naive amp model wrapper (#291)	2022-03-11 15:50:28 +08:00