Commit Graph

1 Commits (c4b1b65931a7614bfbed180c1e18c39b7cb61c2d)

Author SHA1 Message Date
FoolPlayer 92f6791095 [shardformer] Add layernorm (#4072)
* add layernorm to bert

* add layernorm test

* add layernorm test with load state dict

* add use_mixedfusedLN in shard config

* refactor policy to support fused_layernorm
2023-07-04 16:05:01 +08:00