ColossalAI/colossalai/zero/sharded_optim
HELSON d565a24849
[zero] add unit testings for hybrid parallelism (#2486)
2023-01-18 10:36:10 +08:00
..
bookkeeping [zero] add unit testings for hybrid parallelism (#2486) 2023-01-18 10:36:10 +08:00
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
_utils.py [zero] polish low level optimizer (#2473) 2023-01-13 14:56:17 +08:00
low_level_optim.py [zero] add unit testings for hybrid parallelism (#2486) 2023-01-18 10:36:10 +08:00
sharded_optim_v2.py fix move fp32 shards (#1604) 2022-09-16 17:33:16 +08:00