ColossalAI/colossalai/utils
LuGY 140263a394
[hotfix]fixed bugs of assigning grad states to non leaf nodes (#711)
* fixed bugs of assigning grad states to non leaf nodes

* use detach()
2022-04-11 14:04:58 +08:00
..
data_sampler Refactored docstring to google style 2022-03-29 17:17:47 +08:00
gradient_accumulation Refactored docstring to google style 2022-03-29 17:17:47 +08:00
memory_tracer [zero] refactor memstats collector (#706) 2022-04-11 10:46:08 +08:00
memory_utils [refactor] memory utils (#577) 2022-04-01 09:22:33 +08:00
multi_tensor_apply Refactored docstring to google style 2022-03-29 17:17:47 +08:00
profiler polish utils docstring (#620) 2022-04-01 16:36:47 +08:00
tensor_detector Refactored docstring to google style 2022-03-29 17:17:47 +08:00
__init__.py [zero] refactor memstats collector (#706) 2022-04-11 10:46:08 +08:00
activation_checkpoint.py [hotfix]fixed bugs of assigning grad states to non leaf nodes (#711) 2022-04-11 14:04:58 +08:00
checkpointing.py polish checkpoint docstring (#637) 2022-04-02 13:34:33 +08:00
common.py [zero] refactor memstats collector (#706) 2022-04-11 10:46:08 +08:00
cuda.py Fixed docstring in colossalai (#171) 2022-01-21 10:44:30 +08:00
moe.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00
timer.py Refactored docstring to google style 2022-03-29 17:17:47 +08:00