11 Commits (3a41e8304e1ec5ff1688d1967fea5376581c5a5c)

Author	SHA1	Message	Date
Baizhou Zhang	21ba89cab6	[gemini] support gradient accumulation (#4869) ... * add test * fix no_sync bug in low level zero plugin * fix test * add argument for grad accum * add grad accum in backward hook for gemini * finish implementation, rewrite tests * fix test * skip stuck model in low level zero test * update doc * optimize communication & fix gradient checkpoint * modify doc * cleaning codes * update cpu adam fp16 case	2023-10-17 14:07:21 +08:00
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752) ... * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	2023-09-19 14:20:26 +08:00
digger-yu	b7141c36dd	[CI] fix some spelling errors (#3707) ... * fix spelling error with examples/comminity/ * fix spelling error with tests/ * fix some spelling error with tests/ colossalai/ etc.	2023-05-10 17:12:03 +08:00
Jiarui Fang	616ed91ecd	[test] bert test in non-distributed way (#2074)	2022-12-05 13:32:16 +08:00
Jiarui Fang	eb7742a4bb	[Gemini] more tests for Gemini (#2038) ... * [Gemini] more tests for Gemini * polish code	2022-11-29 17:13:10 +08:00
HELSON	537e181705	[testing] fix testing models (#2036) ... * [testing] fix testing models * roll back	2022-11-29 13:42:06 +08:00
Ziyue Jiang	dfaff4e243	[Tensor] fix test_model (#916) ... * polish test_model * polish	2022-05-06 18:06:22 +08:00
Jiarui Fang	370f567e7d	[zero] new interface for ShardedOptimv2 (#406)	2022-03-14 20:48:41 +08:00
ver217	f5f0ad266e	fix bert unit test	2022-03-11 15:50:28 +08:00
jiaruifang	4d94cd513e	adapting bert unitest interface	2022-03-11 15:50:28 +08:00
jiaruifang	7977422aeb	add bert for unitest and sharded model is not able to pass the bert case	2022-03-11 15:50:28 +08:00