ColossalAI

Author	SHA1	Message	Date
Jiarui Fang	1190b2c4a4	[tensor] add cross_entrophy_loss (#868 )	2022-04-25 16:01:52 +08:00
Frank Lee	1258af71cc	[ci] cache cuda extension (#860 )	2022-04-25 10:03:47 +08:00
Ziyue Jiang	bcc8655021	[Tensor ] Add 1Drow weight reshard by spec (#854 )	2022-04-24 18:30:20 +08:00
Jiarui Fang	62f059251b	[Tensor] init a tp network training unittest (#849 )	2022-04-24 16:43:44 +08:00
HELSON	055fbf5be6	[zero] adapt zero for unsharded paramters (Optimizer part) (#601 )	2022-04-01 20:10:47 +08:00
HELSON	a30e2b4c24	[zero] adapt for no-leaf module in zero (#535 ) only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself	2022-03-28 17:42:18 +08:00
Jiarui Fang	370f567e7d	[zero] new interface for ShardedOptimv2 (#406 )	2022-03-14 20:48:41 +08:00
Frank Lee	526a318032	[unit test] Refactored test cases with component func (#339 ) * refactored test with component func * fixed bug	2022-03-11 15:50:28 +08:00
ver217	f5f0ad266e	fix bert unit test	2022-03-11 15:50:28 +08:00
jiaruifang	4d94cd513e	adapting bert unitest interface	2022-03-11 15:50:28 +08:00
jiaruifang	7977422aeb	add bert for unitest and sharded model is not able to pass the bert case	2022-03-11 15:50:28 +08:00
Jiarui Fang	11bddb6e55	[zero] update zero context init with the updated test utils (#327 )	2022-03-11 15:50:28 +08:00
Frank Lee	6268446b81	[test] refactored testing components (#324 )	2022-03-11 15:50:28 +08:00