ColossalAI/tests/test_gemini/update
HELSON 2458659919
[zero] fix error for BEiT models (#2169)
* [zero] fix error for BEiT models

* [ColoParameter] add unpack operation for tuple arguments

* fix bugs

* fix chunkv2 unit testing

* add assertion for gradient state
2022-12-26 15:03:54 +08:00
..
test_chunk_mgrv2.py [NFC] update chunk manager API (#2119) 2022-12-12 16:57:22 +08:00
test_chunkv2.py [zero] fix error for BEiT models (#2169) 2022-12-26 15:03:54 +08:00
test_convert_torch_module.py [example] add palm pytorch version (#2172) 2022-12-22 10:15:34 +08:00
test_fwd_bwd.py [Gemini] remove eval in gemini unittests! (#2092) 2022-12-07 11:58:37 +08:00
test_gemini_use_rmt.py [Gemini] update API of the chunkmemstatscollector. (#2129) 2022-12-14 00:47:06 +08:00
test_grad_clip.py [zero] add L2 gradient clipping for ZeRO (#2112) 2022-12-09 18:09:17 +08:00
test_optim.py [Gemini] chunk init using runtime visited param order (#2115) 2022-12-12 18:06:16 +08:00
test_search.py [zero] add chunk init function for users (#1729) 2022-10-18 16:31:22 +08:00
test_zeroddp_state_dict.py [Gemini] more tests for Gemini (#2038) 2022-11-29 17:13:10 +08:00
test_zerooptim_state_dict.py [Gemini] add unitests to check gemini correctness (#2015) 2022-11-24 16:51:45 +08:00