ColossalAI/colossalai/zero
Jiarui Fang 7ef3507ace
[zero] show model data cuda memory usage after zero context init. (#515)
2022-03-25 11:23:35 +08:00
..
init_ctx [zero] show model data cuda memory usage after zero context init. (#515) 2022-03-25 11:23:35 +08:00
shard_utils [doc] Update docstring for ZeRO (#459) 2022-03-18 16:48:20 +08:00
sharded_model [zero] show model data cuda memory usage after zero context init. (#515) 2022-03-25 11:23:35 +08:00
sharded_optim [zero] use colo model data api in optimv2 (#511) 2022-03-24 17:19:34 +08:00
sharded_param [zero] sharded model support the reuse of fp16 shard (#495) 2022-03-23 14:59:59 +08:00
__init__.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00