You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero
ver217 8d3250d74b
[zero] ZeRO supports pipeline parallel (#477)
3 years ago
..
init_ctx zero init ctx receives a dp process group (#471) 3 years ago
shard_utils [doc] Update docstring for ZeRO (#459) 3 years ago
sharded_model [zero] ZeRO supports pipeline parallel (#477) 3 years ago
sharded_optim [doc] Update docstring for ZeRO (#459) 3 years ago
sharded_param use double buffer to handle grad 3 years ago
__init__.py [zero] Update initialize for ZeRO (#458) 3 years ago