5 Commits (c7d68b2c2ca3f7fd32056ea952fae4fe239f75ea)

Author	SHA1	Message	Date
digger yu	b0b53a171c	[nfc] fix typo colossalai/shardformer/ (#5133)	11 months ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
FoolPlayer	dd2bf02679	[shardformer] support SAM (#4231) ... * 1.support sam 2.add fused qkv for nn.Linear * update utils support set element in list * overtwrite SamVisionAttention foward to use DropoutForParallelInput * remove unused code	1 year ago
Frank Lee	ae035d305d	[shardformer] added embedding gradient check (#4124)	1 year ago
Frank Lee	f22ddacef0	[shardformer] refactored the shardformer layer structure (#4053)	1 year ago