31 Commits (258b43317c4a5cafb8d3da0ff63c8843443bc448)

Author SHA1 Message Date
HELSON a3100bd50d
[testing] add beit model for unit testings (#2196) 2 years ago
Jiarui Fang deee317b0f
[Gemini] test step-tensor mapping using repeated_computed_layers.py (#2127) 2 years ago
Jiarui Fang 40b7d55bf3
[Gemini] add albert in test models. (#2075) 2 years ago
Jiarui Fang 616ed91ecd
[test] bert test in non-distributed way (#2074) 2 years ago
Jiarui Fang 1e885329f4
[test] align model name with the file name. (#2045) 2 years ago
HELSON 17a3c685b0
[zero] fix unit-tests (#2039) 2 years ago
Jiarui Fang eb7742a4bb
[Gemini] more tests for Gemini (#2038) 2 years ago
HELSON 537e181705
[testing] fix testing models (#2036) 2 years ago
Jiarui Fang 28aa9a4294
[Gemini] more rigorous unit tests for run_fwd_bwd (#2034) 2 years ago
Jiarui Fang 8daf1b4db1
[Gemini] patch for supporting orch.add_ function for ColoTensor (#2003) 2 years ago
Jiarui Fang 2e9cbfca12
[Gemini] add unitests to check gemini correctness (#2015) 2 years ago
Jiarui Fang 3d907faede
[Gemini] add an inline_op_module to common test models and polish unitests. (#2004) 2 years ago
アマデウス e615cfc3a8
[NFC] polish test component gpt code style (#1567) 2 years ago
Frank Lee 65ee6dcc20
[test] ignore 8 gpu test (#1080) 2 years ago
ver217 8e3d0ad8f1
[unit test] refactor test tensor (#1005) 3 years ago
Ziyue Jiang 75d221918a
[Tensor] add 1d vocab loss (#918) 3 years ago
Ziyue Jiang dfaff4e243
[Tensor] fix test_model (#916) 3 years ago
Ziyue Jiang f593a5637e
[Tensor] add embedding tp1d row (#904) 3 years ago
Jiarui Fang 1190b2c4a4
[tensor] add cross_entrophy_loss (#868) 3 years ago
Frank Lee 1258af71cc
[ci] cache cuda extension (#860) 3 years ago
Ziyue Jiang bcc8655021
[Tensor ] Add 1Drow weight reshard by spec (#854) 3 years ago
Jiarui Fang 62f059251b
[Tensor] init a tp network training unittest (#849) 3 years ago
HELSON 055fbf5be6
[zero] adapt zero for unsharded paramters (Optimizer part) (#601) 3 years ago
HELSON a30e2b4c24
[zero] adapt for no-leaf module in zero (#535) 3 years ago
Jiarui Fang 370f567e7d
[zero] new interface for ShardedOptimv2 (#406) 3 years ago
Frank Lee 526a318032 [unit test] Refactored test cases with component func (#339) 3 years ago
ver217 f5f0ad266e fix bert unit test 3 years ago
jiaruifang 4d94cd513e adapting bert unitest interface 3 years ago
jiaruifang 7977422aeb add bert for unitest and sharded model is not able to pass the bert case 3 years ago
Jiarui Fang 11bddb6e55 [zero] update zero context init with the updated test utils (#327) 3 years ago
Frank Lee 6268446b81 [test] refactored testing components (#324) 3 years ago