HELSON 84fd7c1d4d add moe context, moe utilities and refactor gradient handler (#455)		2022-03-18 16:38:32 +08:00
..
process_group_initializer	fix format ColossalAI\colossalai\context\process_group_initializer	2022-03-11 15:50:28 +08:00
random	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
__init__.py	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
config.py	update default logger (#100) (#101)	2022-01-04 20:03:26 +08:00
moe_context.py	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
parallel_context.py	add moe context, moe utilities and refactor gradient handler (#455)	2022-03-18 16:38:32 +08:00
parallel_mode.py	adapted for sequence parallel (#163)	2022-01-20 13:44:51 +08:00