ColossalAI/colossalai/engine/gradient_handler
Frank Lee 11f54c7b6b
[doc] improved docstring and assertion messages for the engine module (#871)
2022-04-26 10:00:18 +08:00
..
__init__.py fix format (#585) 2022-04-06 11:40:59 +08:00
_base_gradient_handler.py fix format (#586) 2022-04-06 11:40:59 +08:00
_data_parallel_gradient_handler.py [doc] improved docstring and assertion messages for the engine module (#871) 2022-04-26 10:00:18 +08:00
_moe_gradient_handler.py [doc] improved docstring and assertion messages for the engine module (#871) 2022-04-26 10:00:18 +08:00
_pipeline_parallel_gradient_handler.py [doc] improved docstring and assertion messages for the engine module (#871) 2022-04-26 10:00:18 +08:00
_sequence_parallel_gradient_handler.py [doc] improved docstring and assertion messages for the engine module (#871) 2022-04-26 10:00:18 +08:00
_zero_gradient_handler.py [doc] improved docstring and assertion messages for the engine module (#871) 2022-04-26 10:00:18 +08:00
utils.py add moe context, moe utilities and refactor gradient handler (#455) 2022-03-18 16:38:32 +08:00