You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/colossalai/zero/sharded_optim
HELSON 62c38e3330
[zero] polish low level zero optimizer (#2275)
2 years ago
..
bookkeeping [zero] migrate zero1&2 (#1878) 2 years ago
__init__.py [zero] migrate zero1&2 (#1878) 2 years ago
_utils.py [zero] test gradient accumulation (#1964) 2 years ago
low_level_optim.py [zero] polish low level zero optimizer (#2275) 2 years ago
sharded_optim_v2.py fix move fp32 shards (#1604) 2 years ago