ColossalAI/colossalai/engine/gradient_handler
doubleHU f2da21a827 fix format (#586) 2022-04-06 11:40:59 +08:00
..
__init__.py fix format (#585) 2022-04-06 11:40:59 +08:00
_base_gradient_handler.py fix format (#586) 2022-04-06 11:40:59 +08:00
_data_parallel_gradient_handler.py
_moe_gradient_handler.py [refactor] memory utils (#577) 2022-04-01 09:22:33 +08:00
_pipeline_parallel_gradient_handler.py [zero] ZeRO supports pipeline parallel (#477) 2022-03-21 16:55:37 +08:00
_sequence_parallel_gradient_handler.py
_zero_gradient_handler.py
utils.py