ColossalAI/colossalai/zero/sharded_optim/bookkeeping
HELSON 6e51d296f0
[zero] migrate zero1&2 (#1878)
* add zero1&2 optimizer

* rename test ditectory

* rename test files

* change tolerance in test
2022-11-11 09:26:40 +08:00
..
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
base_store.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
bucket_store.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
gradient_store.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
parameter_store.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
tensor_bucket.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00