6 Commits (fe24789eb178236ad77112824a7d6081ed50dabc)

Author	SHA1	Message	Date
botbw	13b48ac0aa	[zero] solve hang	2024-08-01 10:06:59 +08:00
botbw	b5bfeb2efd	[moe] implement transit between non moe tp and ep	2024-08-01 10:06:59 +08:00
botbw	37443cc7e4	[test] pass mixtral shardformer test	2024-08-01 10:06:59 +08:00
hxwang	46c069b0db	[zero] solve hang	2024-08-01 10:06:59 +08:00
hxwang	a249e71946	[test] mixtra pp shard test	2024-08-01 10:06:59 +08:00
hxwang	0b76b57cd6	[test] add mixtral transformer test	2024-08-01 10:06:59 +08:00