github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/zero/sharded_optim
History
HELSON a1ce02d740
[zero] test gradient accumulation (#1964) 
* [zero] fix memory leak for zero2

* [zero] test gradient accumulation

* [zero] remove grad clip test
 		2022-11-29 13:00:30 +08:00
..
bookkeeping [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
__init__.py [zero] migrate zero1&2 (#1878) 2022-11-11 09:26:40 +08:00
_utils.py [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
low_level_optim.py [zero] test gradient accumulation (#1964) 2022-11-29 13:00:30 +08:00
sharded_optim_v2.py fix move fp32 shards (#1604) 2022-09-16 17:33:16 +08:00