ColossalAI/colossalai/zero/sharded_optim
HELSON 62c38e3330
[zero] polish low level zero optimizer (#2275)
2023-01-03 17:22:34 +08:00
..
bookkeeping [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
_utils.py [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
low_level_optim.py [zero] polish low level zero optimizer (#2275) 2023-01-03 17:22:34 +08:00
sharded_optim_v2.py fix move fp32 shards (#1604) 2022-09-16 17:33:16 +08:00