Commit Graph

7 Commits (8120eca0c0cc4b10f09c2eeb3233d49396ced816)

Author SHA1 Message Date
klhhhhh 4da05052f4 [shardformer] pre-commit check files 2023-08-15 23:25:14 +08:00
klhhhhh f155ae89c4 [shardformer] ChatGLM support layernorm sharding 2023-08-15 23:25:14 +08:00
klhhhhh 00f6ef159d [shardformer] delete some file 2023-08-15 23:25:14 +08:00
klhhhhh dad00c42aa [shardformer] support chatglm without layernorm 2023-08-15 23:25:14 +08:00
klhhhhh cbb54d3202 [shardformer] polish code 2023-08-15 23:25:14 +08:00
klhhhhh 6ee4c9ee21 [shardformer] add test kit in model zoo for chatglm 2023-08-15 23:25:14 +08:00
Kun Lin ed34bb1310 Feature/chatglm (#4240)
* [shardformer] added tests

* [shardformer] vit test finish and support

* [shardformer] chatglm ready

* import chatglm

* [shardformer] add test kit in model zoo for chatglm

* [sharformer] add first version of policy of chatglm

* [shardformer] polish chatglm code

* [shardformer] polish code

* [shardformer] support chatglm without layernorm

* [shardformer] chatglm shard without mlp sharding

* [shardformer] delete some file

* [shardformer] ChatGLM support layernorm sharding

* [shardformer] register without auto policy

* [shardformer] pre-commit check files

* [shardformer] fix chatglm configuration with pre-commit
2023-08-15 23:25:14 +08:00