ColossalAI

Commit Graph

Author	SHA1	Message	Date
Hongxin Liu	079bf3cb26	[misc] update pre-commit and run all files (#4752 ) * [misc] update pre-commit * [misc] run pre-commit * [misc] remove useless configuration files * [misc] ignore cuda for clang-format	1 year ago
Hongxin Liu	b5f9e37c70	[legacy] clean up legacy code (#4743 ) * [legacy] remove outdated codes of pipeline (#4692) * [legacy] remove cli of benchmark and update optim (#4690) * [legacy] remove cli of benchmark and update optim * [doc] fix cli doc test * [legacy] fix engine clip grad norm * [legacy] remove outdated colo tensor (#4694) * [legacy] remove outdated colo tensor * [test] fix test import * [legacy] move outdated zero to legacy (#4696) * [legacy] clean up utils (#4700) * [legacy] clean up utils * [example] update examples * [legacy] clean up amp * [legacy] fix amp module * [legacy] clean up gpc (#4742) * [legacy] clean up context * [legacy] clean core, constants and global vars * [legacy] refactor initialize * [example] fix examples ci * [example] fix examples ci * [legacy] fix tests * [example] fix gpt example * [example] fix examples ci * [devops] fix ci installation * [example] fix examples ci	1 year ago
Hongxin Liu	554aa9592e	[legacy] move communication and nn to legacy and refactor logger (#4671 ) * [legacy] move communication to legacy (#4640) * [legacy] refactor logger and clean up legacy codes (#4654) * [legacy] make logger independent to gpc * [legacy] make optim independent to registry * [legacy] move test engine to legacy * [legacy] move nn to legacy (#4656) * [legacy] move nn to legacy * [checkpointio] fix save hf config * [test] remove useledd rpc pp test * [legacy] fix nn init * [example] skip tutorial hybriad parallel example * [devops] test doc check * [devops] test doc check	1 year ago
digger-yu	1f73609adb	[CI] fix typo with tests/ etc. (#3727 ) * fix spelling error with examples/comminity/ * fix spelling error with tests/ * fix some spelling error with tests/ colossalai/ etc. * fix spelling error with tests/ etc. date:2023.5.10	2 years ago
digger-yu	b7141c36dd	[CI] fix some spelling errors (#3707 ) * fix spelling error with examples/comminity/ * fix spelling error with tests/ * fix some spelling error with tests/ colossalai/ etc.	2 years ago
Hongxin Liu	50793b35f4	[gemini] accelerate inference (#3641 ) * [gemini] support don't scatter after inference * [chat] update colossalai strategy * [chat] fix opt benchmark * [chat] update opt benchmark * [gemini] optimize inference * [test] add gemini inference test * [chat] fix unit test ci * [chat] fix ci * [chat] fix ci * [chat] skip checkpoint test	2 years ago
HELSON	a3100bd50d	[testing] add beit model for unit testings (#2196 ) * [testing] add beit model * [beit] fix bugs * [beit] fix bugs * [testing] fix bugs	2 years ago
Jiarui Fang	deee317b0f	[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127 )	2 years ago
Jiarui Fang	40b7d55bf3	[Gemini] add albert in test models. (#2075 )	2 years ago
Jiarui Fang	616ed91ecd	[test] bert test in non-distributed way (#2074 )	2 years ago
Jiarui Fang	1e885329f4	[test] align model name with the file name. (#2045 )	2 years ago
HELSON	17a3c685b0	[zero] fix unit-tests (#2039 )	2 years ago
Jiarui Fang	eb7742a4bb	[Gemini] more tests for Gemini (#2038 ) * [Gemini] more tests for Gemini * polish code	2 years ago
HELSON	537e181705	[testing] fix testing models (#2036 ) * [testing] fix testing models * roll back	2 years ago
Jiarui Fang	28aa9a4294	[Gemini] more rigorous unit tests for run_fwd_bwd (#2034 )	2 years ago
Jiarui Fang	8daf1b4db1	[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003 )	2 years ago
Jiarui Fang	2e9cbfca12	[Gemini] add unitests to check gemini correctness (#2015 )	2 years ago
Jiarui Fang	3d907faede	[Gemini] add an inline_op_module to common test models and polish unitests. (#2004 )	2 years ago
アマデウス	e615cfc3a8	[NFC] polish test component gpt code style (#1567 )	2 years ago
Frank Lee	65ee6dcc20	[test] ignore 8 gpu test (#1080 ) * [test] ignore 8 gpu test * polish code * polish workflow * polish workflow	2 years ago
ver217	8e3d0ad8f1	[unit test] refactor test tensor (#1005 ) * polish test_gpt * update op unit tests * update test model	3 years ago
Ziyue Jiang	75d221918a	[Tensor] add 1d vocab loss (#918 ) * add 1d vocab loss * polish	3 years ago
Ziyue Jiang	dfaff4e243	[Tensor] fix test_model (#916 ) * polish test_model * polish	3 years ago
Ziyue Jiang	f593a5637e	[Tensor] add embedding tp1d row (#904 )	3 years ago
Jiarui Fang	1190b2c4a4	[tensor] add cross_entrophy_loss (#868 )	3 years ago
Frank Lee	1258af71cc	[ci] cache cuda extension (#860 )	3 years ago
Ziyue Jiang	bcc8655021	[Tensor ] Add 1Drow weight reshard by spec (#854 )	3 years ago
Jiarui Fang	62f059251b	[Tensor] init a tp network training unittest (#849 )	3 years ago
HELSON	055fbf5be6	[zero] adapt zero for unsharded paramters (Optimizer part) (#601 )	3 years ago
HELSON	a30e2b4c24	[zero] adapt for no-leaf module in zero (#535 ) only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself	3 years ago
Jiarui Fang	370f567e7d	[zero] new interface for ShardedOptimv2 (#406 )	3 years ago
Frank Lee	526a318032	[unit test] Refactored test cases with component func (#339 ) * refactored test with component func * fixed bug	3 years ago
ver217	f5f0ad266e	fix bert unit test	3 years ago
jiaruifang	4d94cd513e	adapting bert unitest interface	3 years ago
jiaruifang	7977422aeb	add bert for unitest and sharded model is not able to pass the bert case	3 years ago
Jiarui Fang	11bddb6e55	[zero] update zero context init with the updated test utils (#327 )	3 years ago
Frank Lee	6268446b81	[test] refactored testing components (#324 )	3 years ago

37 Commits (39f2582e987871c198f2f2526cd4435cbd569741)