ColossalAI

Author	SHA1	Message	Date
Boyuan Yao	47fd8e4a02	[utils] Add use_reetrant=False in utils.activation_checkpoint (#1460 ) * [utils] Add use_reetrant=False into colossalai checkpoint * [utils] add some annotation in utils.activaion_checkpoint * [test] add reset_seed at the beginning of tests in test_actiavion_checkpointing.py * [test] modify test_activation_checkpoint.py * [test] modify test for reentrant=False	2022-08-16 15:39:20 +08:00
Frank Lee	2412429d54	[util] fixed activation checkpointing on torch 1.9 (#719 )	2022-04-12 09:35:45 +08:00
LuGY	140263a394	[hotfix]fixed bugs of assigning grad states to non leaf nodes (#711 ) * fixed bugs of assigning grad states to non leaf nodes * use detach()	2022-04-11 14:04:58 +08:00
HELSON	e5d615aeee	[hotfix] fix bugs in testing (#659 ) * remove hybrid adam in test_moe_zero_optim * fix activation checkpointing and its unitest	2022-04-02 21:58:47 +08:00
LuGY	1e2557e801	[zero] fixed the activation offload (#647 ) * fixed the activation offload * polish	2022-04-02 16:21:32 +08:00
Liang Bowen	ec5086c49c	Refactored docstring to google style	2022-03-29 17:17:47 +08:00
LuGY	de46450461	Added activation offload (#331 ) * Added activation offload * Fixed the import bug, used the pytest	2022-03-11 15:50:28 +08:00
HELSON	0f8c7f9804	Fixed docstring in colossalai (#171 )	2022-01-21 10:44:30 +08:00
zbian	404ecbdcc6	Migrated project	2021-10-28 18:21:23 +02:00