11 Commits (f28c0213769dbb2037cd08123ecbf1c8a3f5114b)

Author	SHA1	Message	Date
ver217	c2fdc6a011	[tensor] derive compute pattern from dist spec (#971) ... * derive compute pattern from dist spec * polish code	2022-05-16 14:58:08 +08:00
Ziyue Jiang	797a9dc5a9	add DistSpec for loss and test_model (#947)	2022-05-13 20:29:50 +08:00
ver217	67c33f57eb	[tensor] design DistSpec and DistSpecManager for ColoTensor (#934) ... * add dist spec * update linear op * polish code * polish code * update embedding op * polish unit tests * polish unit tests * polish comments * polish code * add test_dist_spec_mgr * polish code * refactor folder structure * polish unit tests * add get_process_group() for TensorSpec * polish code	2022-05-13 15:13:52 +08:00
ver217	45b9124df4	[tensor] hijack addmm for colo tensor (#923) ... * hijack addmm for colo tensor * fix bugs * polish unit test * polish comments	2022-05-09 18:55:49 +08:00
Ziyue Jiang	2c0d19d755	[Tensor] add ColoTensor TP1Dcol Embedding (#899)	2022-04-28 17:45:06 +08:00
Jiarui Fang	676f191532	[Tensor] activation is an attr of ColoTensor (#897)	2022-04-28 14:43:22 +08:00
Ziyue Jiang	cb182da7c5	[tensor] refine linear and add gather for laynorm (#893) ... * refine linear and add function to ColoTensor * add gather for layernorm * polish * polish	2022-04-28 10:55:40 +08:00
Ziyue Jiang	1d0aba4153	[tensor] add ColoTensor 1Dcol (#888)	2022-04-27 14:13:55 +08:00
Jiarui Fang	96211c2cc8	[tensor] customized op returns ColoTensor (#875) ... * [tensor] customized op returns ColoTensor * polish * polish code	2022-04-26 13:23:59 +08:00
Ziyue Jiang	26d4ab8b03	[Tensor] Add function to spec and update linear 1Drow and unit tests (#869)	2022-04-26 10:15:26 +08:00
Jiarui Fang	8af5f7423d	[tensor] an initial dea of tensor spec (#865) ... * a initial dea of tensor spec * polish * polish	2022-04-25 13:33:52 +08:00