ColossalAI

Author	SHA1	Message	Date
klhhhhh	8120eca0c0	[shardformer] support ChatGLMForConditionalGeneration & add fusedlayernorm for vit	2023-08-15 23:25:14 +08:00
klhhhhh	1a29e8fc29	[shardformer] polish chatglm code	2023-08-15 23:25:14 +08:00
klhhhhh	8620009dd7	[sharformer] add first version of policy of chatglm	2023-08-15 23:25:14 +08:00
Kun Lin	ed34bb1310	Feature/chatglm (#4240 ) * [shardformer] added tests * [shardformer] vit test finish and support * [shardformer] chatglm ready * import chatglm * [shardformer] add test kit in model zoo for chatglm * [sharformer] add first version of policy of chatglm * [shardformer] polish chatglm code * [shardformer] polish code * [shardformer] support chatglm without layernorm * [shardformer] chatglm shard without mlp sharding * [shardformer] delete some file * [shardformer] ChatGLM support layernorm sharding * [shardformer] register without auto policy * [shardformer] pre-commit check files * [shardformer] fix chatglm configuration with pre-commit	2023-08-15 23:25:14 +08:00