You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

HELSON b528eea0f0 [zero] add zero wrappers (#2523) ... * [zero] add zero wrappers * change names * add wrapper functions to init		2 years ago
..
bookkeeping	[zero] add unit testings for hybrid parallelism (#2486)	2 years ago
__init__.py	[zero] migrate zero1&2 (#1878)	2 years ago
_utils.py	[zero] fix gradient clipping in hybrid parallelism (#2521)	2 years ago
low_level_optim.py	[zero] add zero wrappers (#2523)	2 years ago
sharded_optim_v2.py	fix move fp32 shards (#1604)	2 years ago