ColossalAI/colossalai/zero/sharded_optim
HELSON a1ce02d740
[zero] test gradient accumulation (#1964)
* [zero] fix memory leak for zero2

* [zero] test gradient accumulation

* [zero] remove grad clip test
2022-11-29 13:00:30 +08:00
..
bookkeeping
__init__.py
_utils.py [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
low_level_optim.py [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
sharded_optim_v2.py