ColossalAI

History

flybird11111 7486ed7d3a [shardformer] update llama2/opt finetune example and fix llama2 policy (#4645 ) * [shardformer] update shardformer readme [shardformer] update shardformer readme [shardformer] update shardformer readme * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] update llama2/opt finetune example and shardformer update to llama2 * [shardformer] change dataset * [shardformer] change dataset * [shardformer] fix CI * [shardformer] fix * [shardformer] fix * [shardformer] fix * [shardformer] fix * [shardformer] fix [example] update opt example [example] resolve comments fix fix		2023-09-09 22:45:36 +08:00
..
__init__.py	rename chatglm to chatglm2 (#4484 )	2023-08-22 14:13:31 +08:00
albert.py	[gemini] improve compatibility and add static placement policy (#4479 )	2023-08-24 09:29:25 +08:00
bert.py	[gemini] improve compatibility and add static placement policy (#4479 )	2023-08-24 09:29:25 +08:00
blip2.py	[Shardformer] Merge flash attention branch to pipeline branch (#4362 )	2023-08-15 23:25:14 +08:00
bloom.py	[shardformer] rewrite tests for opt/bloom/llama/vit/chatglm (#4395 )	2023-08-15 23:25:14 +08:00
chatglm2.py	[shardformer] chatglm support sequence parallel (#4482 )	2023-08-22 23:59:31 +08:00
gpt.py	[shardformer] update llama2/opt finetune example and fix llama2 policy (#4645 )	2023-09-09 22:45:36 +08:00
llama.py	[shardformer] update llama2/opt finetune example and fix llama2 policy (#4645 )	2023-09-09 22:45:36 +08:00
opt.py	[shardformer] update llama2/opt finetune example and fix llama2 policy (#4645 )	2023-09-09 22:45:36 +08:00
sam.py	[shardformer] support SAM (#4231 )	2023-08-15 23:25:14 +08:00
t5.py	[shardformer]update t5 tests for using all optimizations. (#4407 )	2023-08-15 23:25:14 +08:00
vit.py	[shardformer] rewrite tests for opt/bloom/llama/vit/chatglm (#4395 )	2023-08-15 23:25:14 +08:00
whisper.py	[Shardformer] Merge flash attention branch to pipeline branch (#4362 )	2023-08-15 23:25:14 +08:00