Frank Lee
|
2412429d54
|
[util] fixed activation checkpointing on torch 1.9 (#719)
|
2022-04-12 09:35:45 +08:00 |
LuGY
|
140263a394
|
[hotfix]fixed bugs of assigning grad states to non leaf nodes (#711)
* fixed bugs of assigning grad states to non leaf nodes
* use detach()
|
2022-04-11 14:04:58 +08:00 |
HELSON
|
e5d615aeee
|
[hotfix] fix bugs in testing (#659)
* remove hybrid adam in test_moe_zero_optim
* fix activation checkpointing and its unitest
|
2022-04-02 21:58:47 +08:00 |
LuGY
|
1e2557e801
|
[zero] fixed the activation offload (#647)
* fixed the activation offload
* polish
|
2022-04-02 16:21:32 +08:00 |
Liang Bowen
|
ec5086c49c
|
Refactored docstring to google style
|
2022-03-29 17:17:47 +08:00 |
LuGY
|
de46450461
|
Added activation offload (#331)
* Added activation offload
* Fixed the import bug, used the pytest
|
2022-03-11 15:50:28 +08:00 |
HELSON
|
0f8c7f9804
|
Fixed docstring in colossalai (#171)
|
2022-01-21 10:44:30 +08:00 |
zbian
|
404ecbdcc6
|
Migrated project
|
2021-10-28 18:21:23 +02:00 |