10 Commits (2703a37ac91beffa3e62a0e179726fa5d15d73b1)

Author	SHA1	Message	Date
LuGY	1ff7d5bfa5	[NFC] polish colossalai/engine/gradient_handler/_moe_gradient_handler.py (#3260)	2 years ago
Frank Lee	11f54c7b6b	[doc] improved docstring and assertion messages for the engine module (#871)	3 years ago
Jiarui Fang	e956d93ac2	[refactor] memory utils (#577)	3 years ago
HELSON	e6d50ec107	[zero] adapt zero for unsharded parameters (#561) ... * support existing sharded and unsharded parameters in zero * add unitest for moe-zero model init * polish moe gradient handler	3 years ago
Jiarui Fang	a445e118cf	[polish] polish singleton and global context (#500)	3 years ago
Jiarui Fang	65c0f380c2	[format] polish name format for MOE (#481)	3 years ago
HELSON	aff9d354f7	[MOE] polish moe_env (#467)	3 years ago
HELSON	84fd7c1d4d	add moe context, moe utilities and refactor gradient handler (#455)	3 years ago
HELSON	0f8c7f9804	Fixed docstring in colossalai (#171)	3 years ago
HELSON	dceae85195	Added MoE parallel (#127)	3 years ago