5 Commits (f47f2fbb2467df15548d2c663b119f4ae0103890)

Author	SHA1	Message	Date
digger yu	b0b53a171c	[nfc] fix typo colossalai/shardformer/ (#5133)	2024-01-04 16:21:55 +08:00
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	2023-09-19 14:20:26 +08:00
FoolPlayer	dd2bf02679	[shardformer] support SAM (#4231) ... * 1.support sam 2.add fused qkv for nn.Linear * update utils support set element in list * overtwrite SamVisionAttention foward to use DropoutForParallelInput * remove unused code	2023-08-15 23:25:14 +08:00
Frank Lee	ae035d305d	[shardformer] added embedding gradient check (#4124)	2023-07-04 16:05:01 +08:00
Frank Lee	f22ddacef0	[shardformer] refactored the shardformer layer structure (#4053)	2023-07-04 16:05:01 +08:00