16 Commits (f28c0213769dbb2037cd08123ecbf1c8a3f5114b)

Author	SHA1	Message	Date
Ziyue Jiang	75d221918a	[Tensor] add 1d vocab loss (#918) ... * add 1d vocab loss * polish	2022-05-07 15:49:14 +08:00
Ziyue Jiang	dfaff4e243	[Tensor] fix test_model (#916) ... * polish test_model * polish	2022-05-06 18:06:22 +08:00
Ziyue Jiang	f593a5637e	[Tensor] add embedding tp1d row (#904)	2022-04-29 14:10:05 +08:00
Jiarui Fang	1190b2c4a4	[tensor] add cross_entrophy_loss (#868)	2022-04-25 16:01:52 +08:00
Frank Lee	1258af71cc	[ci] cache cuda extension (#860)	2022-04-25 10:03:47 +08:00
Ziyue Jiang	bcc8655021	[Tensor ] Add 1Drow weight reshard by spec (#854)	2022-04-24 18:30:20 +08:00
Jiarui Fang	62f059251b	[Tensor] init a tp network training unittest (#849)	2022-04-24 16:43:44 +08:00
HELSON	055fbf5be6	[zero] adapt zero for unsharded paramters (Optimizer part) (#601)	2022-04-01 20:10:47 +08:00
HELSON	a30e2b4c24	[zero] adapt for no-leaf module in zero (#535) ... only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself	2022-03-28 17:42:18 +08:00
Jiarui Fang	370f567e7d	[zero] new interface for ShardedOptimv2 (#406)	2022-03-14 20:48:41 +08:00
Frank Lee	526a318032	[unit test] Refactored test cases with component func (#339) ... * refactored test with component func * fixed bug	2022-03-11 15:50:28 +08:00
ver217	f5f0ad266e	fix bert unit test	2022-03-11 15:50:28 +08:00
jiaruifang	4d94cd513e	adapting bert unitest interface	2022-03-11 15:50:28 +08:00
jiaruifang	7977422aeb	add bert for unitest and sharded model is not able to pass the bert case	2022-03-11 15:50:28 +08:00
Jiarui Fang	11bddb6e55	[zero] update zero context init with the updated test utils (#327)	2022-03-11 15:50:28 +08:00
Frank Lee	6268446b81	[test] refactored testing components (#324)	2022-03-11 15:50:28 +08:00