FoolPlayer 92f6791095 [shardformer] Add layernorm (#4072) ... * add layernorm to bert * add layernorm test * add layernorm test with load state dict * add use_mixedfusedLN in shard config * refactor policy to support fused_layernorm		2023-07-04 16:05:01 +08:00
..
__init__.py	[shardformer] Refactor shardformer api (#4001)	2023-07-04 16:05:01 +08:00
shard_config.py	[shardformer] Add layernorm (#4072)	2023-07-04 16:05:01 +08:00
sharder.py	[shardformer] refactored the shardformer layer structure (#4053)	2023-07-04 16:05:01 +08:00
shardformer.py	[shardformer] adapted llama to the new API (#4036)	2023-07-04 16:05:01 +08:00