ColossalAI/colossalai/zero/sharded_optim
HELSON 6e51d296f0
[zero] migrate zero1&2 (#1878)
* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test
2022-11-11 09:26:40 +08:00
..
bookkeeping [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
_utils.py [refactor] zero directory (#724) 2022-04-11 23:13:02 +08:00
low_level_optim.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
sharded_optim_v2.py fix move fp32 shards (#1604) 2022-09-16 17:33:16 +08:00