32 Commits (0f785cb1f332bfa1643b4dedd2ce38950b4a3179)

Author	SHA1	Message	Date
Hongxin Liu	50793b35f4	[gemini] accelerate inference (#3641) ... * [gemini] support don't scatter after inference * [chat] update colossalai strategy * [chat] fix opt benchmark * [chat] update opt benchmark * [gemini] optimize inference * [test] add gemini inference test * [chat] fix unit test ci * [chat] fix ci * [chat] fix ci * [chat] skip checkpoint test	2 years ago
HELSON	a3100bd50d	[testing] add beit model for unit testings (#2196) ... * [testing] add beit model * [beit] fix bugs * [beit] fix bugs * [testing] fix bugs	2 years ago
Jiarui Fang	deee317b0f	[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127)	2 years ago
Jiarui Fang	40b7d55bf3	[Gemini] add albert in test models. (#2075)	2 years ago
Jiarui Fang	616ed91ecd	[test] bert test in non-distributed way (#2074)	2 years ago
Jiarui Fang	1e885329f4	[test] align model name with the file name. (#2045)	2 years ago
HELSON	17a3c685b0	[zero] fix unit-tests (#2039)	2 years ago
Jiarui Fang	eb7742a4bb	[Gemini] more tests for Gemini (#2038) ... * [Gemini] more tests for Gemini * polish code	2 years ago
HELSON	537e181705	[testing] fix testing models (#2036) ... * [testing] fix testing models * roll back	2 years ago
Jiarui Fang	28aa9a4294	[Gemini] more rigorous unit tests for run_fwd_bwd (#2034)	2 years ago
Jiarui Fang	8daf1b4db1	[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003)	2 years ago
Jiarui Fang	2e9cbfca12	[Gemini] add unitests to check gemini correctness (#2015)	2 years ago
Jiarui Fang	3d907faede	[Gemini] add an inline_op_module to common test models and polish unitests. (#2004)	2 years ago
アマデウス	e615cfc3a8	[NFC] polish test component gpt code style (#1567)	2 years ago
Frank Lee	65ee6dcc20	[test] ignore 8 gpu test (#1080) ... * [test] ignore 8 gpu test * polish code * polish workflow * polish workflow	3 years ago
ver217	8e3d0ad8f1	[unit test] refactor test tensor (#1005) ... * polish test_gpt * update op unit tests * update test model	3 years ago
Ziyue Jiang	75d221918a	[Tensor] add 1d vocab loss (#918) ... * add 1d vocab loss * polish	3 years ago
Ziyue Jiang	dfaff4e243	[Tensor] fix test_model (#916) ... * polish test_model * polish	3 years ago
Ziyue Jiang	f593a5637e	[Tensor] add embedding tp1d row (#904)	3 years ago
Jiarui Fang	1190b2c4a4	[tensor] add cross_entrophy_loss (#868)	3 years ago
Frank Lee	1258af71cc	[ci] cache cuda extension (#860)	3 years ago
Ziyue Jiang	bcc8655021	[Tensor ] Add 1Drow weight reshard by spec (#854)	3 years ago
Jiarui Fang	62f059251b	[Tensor] init a tp network training unittest (#849)	3 years ago
HELSON	055fbf5be6	[zero] adapt zero for unsharded paramters (Optimizer part) (#601)	3 years ago
HELSON	a30e2b4c24	[zero] adapt for no-leaf module in zero (#535) ... only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself	3 years ago
Jiarui Fang	370f567e7d	[zero] new interface for ShardedOptimv2 (#406)	3 years ago
Frank Lee	526a318032	[unit test] Refactored test cases with component func (#339) ... * refactored test with component func * fixed bug	3 years ago
ver217	f5f0ad266e	fix bert unit test	3 years ago
jiaruifang	4d94cd513e	adapting bert unitest interface	3 years ago
jiaruifang	7977422aeb	add bert for unitest and sharded model is not able to pass the bert case	3 years ago
Jiarui Fang	11bddb6e55	[zero] update zero context init with the updated test utils (#327)	3 years ago
Frank Lee	6268446b81	[test] refactored testing components (#324)	3 years ago