ColossalAI/colossalai/engine/gradient_handler
HELSON 84fd7c1d4d
add moe context, moe utilities and refactor gradient handler (#455)
2022-03-18 16:38:32 +08:00
..
__init__.py moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
_base_gradient_handler.py Migrated project 2021-10-28 18:21:23 +02:00
_data_parallel_gradient_handler.py add moe context, moe utilities and refactor gradient handler (#455) 2022-03-18 16:38:32 +08:00
_moe_gradient_handler.py add moe context, moe utilities and refactor gradient handler (#455) 2022-03-18 16:38:32 +08:00
_pipeline_parallel_gradient_handler.py Optimize pipeline schedule (#94) 2021-12-30 15:56:46 +08:00
_sequence_parallel_gradient_handler.py add moe context, moe utilities and refactor gradient handler (#455) 2022-03-18 16:38:32 +08:00
_zero_gradient_handler.py Flake8 code restyle 2022-03-11 15:50:28 +08:00
utils.py add moe context, moe utilities and refactor gradient handler (#455) 2022-03-18 16:38:32 +08:00