ColossalAI/colossalai/zero
Jiarui Fang 00670c870e [zero] bucketized tensor cpu gpu copy (#368) 2022-03-11 15:50:28 +08:00
..
init_ctx [zero] able to place params on cpu after zero init context (#365) 2022-03-11 15:50:28 +08:00
shard_utils [zero] able to place params on cpu after zero init context (#365) 2022-03-11 15:50:28 +08:00
sharded_model fix grad shape 2022-03-11 15:50:28 +08:00
sharded_optim [zero] bucketized tensor cpu gpu copy (#368) 2022-03-11 15:50:28 +08:00
sharded_param [zero] bucketized tensor cpu gpu copy (#368) 2022-03-11 15:50:28 +08:00
__init__.py added buffer sync to naive amp model wrapper (#291) 2022-03-11 15:50:28 +08:00