ColossalAI/colossalai/zero
Jiarui Fang bca0c49a9d
[zero] use colo model data api in optimv2 (#511)
2022-03-24 17:19:34 +08:00
..
init_ctx [zero] polish sharded param name (#484) 2022-03-22 14:36:16 +08:00
shard_utils [doc] Update docstring for ZeRO (#459) 2022-03-18 16:48:20 +08:00
sharded_model [memory] add model data tensor moving api (#503) 2022-03-24 14:29:41 +08:00
sharded_optim [zero] use colo model data api in optimv2 (#511) 2022-03-24 17:19:34 +08:00
sharded_param [zero] sharded model support the reuse of fp16 shard (#495) 2022-03-23 14:59:59 +08:00
__init__.py [zero] Update initialize for ZeRO (#458) 2022-03-18 16:18:31 +08:00