3 Commits (879301d0dad26a056e0e90d8c9c9d6cc4a662c9a)

Author	SHA1	Message	Date
FoolPlayer	dd2bf02679	[shardformer] support SAM (#4231) ... * 1.support sam 2.add fused qkv for nn.Linear * update utils support set element in list * overtwrite SamVisionAttention foward to use DropoutForParallelInput * remove unused code	2023-08-15 23:25:14 +08:00
Frank Lee	ae035d305d	[shardformer] added embedding gradient check (#4124)	2023-07-04 16:05:01 +08:00
Frank Lee	f22ddacef0	[shardformer] refactored the shardformer layer structure (#4053)	2023-07-04 16:05:01 +08:00