github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/tests/test_zero/low_level_zero
History
HELSON b528eea0f0
[zero] add zero wrappers (#2523) 
* [zero] add zero wrappers

* change names

* add wrapper functions to init
 		2023-01-29 17:52:58 +08:00
..
test_grad_acc.py [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00
test_zero1_2.py [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00
test_zero_init.py [zero] fix gradient clipping in hybrid parallelism (#2521) 2023-01-29 15:09:57 +08:00
test_zero_tp.py [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00