ColossalAI

Author	SHA1	Message	Date
Ziyue Jiang	797a9dc5a9	add DistSpec for loss and test_model (#947 )	2022-05-13 20:29:50 +08:00
ver217	67c33f57eb	[tensor] design DistSpec and DistSpecManager for ColoTensor (#934 ) * add dist spec * update linear op * polish code * polish code * update embedding op * polish unit tests * polish unit tests * polish comments * polish code * add test_dist_spec_mgr * polish code * refactor folder structure * polish unit tests * add get_process_group() for TensorSpec * polish code	2022-05-13 15:13:52 +08:00
Ziyue Jiang	2c0d19d755	[Tensor] add ColoTensor TP1Dcol Embedding (#899 )	2022-04-28 17:45:06 +08:00
Ziyue Jiang	cb182da7c5	[tensor] refine linear and add gather for laynorm (#893 ) * refine linear and add function to ColoTensor * add gather for layernorm * polish * polish	2022-04-28 10:55:40 +08:00
Jiarui Fang	1190b2c4a4	[tensor] add cross_entrophy_loss (#868 )	2022-04-25 16:01:52 +08:00
Jiarui Fang	126ba573a8	[Tensor] add layer norm Op (#852 )	2022-04-25 11:49:20 +08:00