7 Commits (c7d68b2c2ca3f7fd32056ea952fae4fe239f75ea)

Author	SHA1	Message	Date
Jianghai	ef4c14a5e2	[Inference] Fix bug in ChatGLM2 Tensor Parallelism (#5014) ... * fix bug * fix * fix multiquery * fix multiquery --------- Co-authored-by: CjhHa1 <cjh18671720497outlook.com>	1 year ago
littsk	1a3315e336	[hotfix] Add layer norm gradients all-reduce for sequence parallel (#4926) ... * [hotfix] Add layer norm gradients all-reduce for sequence parallel. (#4915) * Add layer norm gradients all-reduce for sequence parallel. * skip pipeline inference test * [hotfix] fixing polices of sequence parallel (#4922) * Add layer norm gradients all-reduce for sequence parallel. * fix parameter passing when calling get_autopolicy --------- Co-authored-by: littsk <1214689160@qq.com> * Hotfix/add grad all reduce for sequence parallel (#4927) * Add layer norm gradients all-reduce for sequence parallel. * fix parameter passing when calling get_autopolicy * fix bug using wrong variables --------- Co-authored-by: littsk <1214689160@qq.com> * fix policy initialization * fix bloom and chatglm policices * polish code of handling layernorm * fix moe module * polish code of class initializing --------- Co-authored-by: Zhongkai Zhao <kanezz620@gmail.com>	1 year ago
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
Jianghai	24c0768795	[shardformer] Pytree fix (#4533) ... * pytree test * test bert * test bert * test bert * revise * add register * add register	1 year ago
Bin Jia	c554b7f559	[shardformer/fix overlap bug] fix overlap bug, add overlap as an option in shardco… (#4516) ... * fix overlap bug and support bert, add overlap as an option in shardconfig * support overlap for chatglm and bloom	1 year ago
flybird11111	59e252ecdb	[shardformer] chatglm support sequence parallel (#4482) ... * [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel [shardformer] chatglm support sequence parallel * fix fix fix fix	1 year ago
Jianghai	5545114fd8	rename chatglm to chatglm2 (#4484)	1 year ago