ColossalAI/colossalai/engine/gradient_handler
ver217 7c70bfbefa
[hotfix] fix PipelineSharedModuleGradientHandler (#1314)
2022-07-14 17:31:13 +08:00
..
__init__.py
_base_gradient_handler.py
_data_parallel_gradient_handler.py
_moe_gradient_handler.py
_pipeline_parallel_gradient_handler.py [hotfix] fix PipelineSharedModuleGradientHandler (#1314) 2022-07-14 17:31:13 +08:00
_sequence_parallel_gradient_handler.py
_zero_gradient_handler.py
utils.py