5 Commits (10a19e22c63aa9963a889874b63c47ccd0e6db42)

Author	SHA1	Message	Date
digger yu	b0b53a171c	[nfc] fix typo colossalai/shardformer/ (#5133)	11 months ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
FoolPlayer	dd2bf02679	[shardformer] support SAM (#4231) ... * 1.support sam 2.add fused qkv for nn.Linear * update utils support set element in list * overtwrite SamVisionAttention foward to use DropoutForParallelInput * remove unused code	1 year ago
Frank Lee	ae035d305d	[shardformer] added embedding gradient check (#4124)	1 year ago
Frank Lee	f22ddacef0	[shardformer] refactored the shardformer layer structure (#4053)	1 year ago