ColossalAI/colossalai/zero
Jiarui Fang 23ba3fc450
[zero] refactory ShardedOptimV2 init method (#416)
2022-03-15 10:45:55 +08:00
..
init_ctx [zero] memtracer to record cuda memory usage of model data and overall system (#395) 2022-03-14 22:05:30 +08:00
shard_utils polish code 2022-03-14 15:48:55 +08:00
sharded_model [zero] memtracer to record cuda memory usage of model data and overall system (#395) 2022-03-14 22:05:30 +08:00
sharded_optim [zero] refactory ShardedOptimV2 init method (#416) 2022-03-15 10:45:55 +08:00
sharded_param [zero] find miss code (#378) 2022-03-11 15:50:28 +08:00
__init__.py added buffer sync to naive amp model wrapper (#291) 2022-03-11 15:50:28 +08:00