11 Commits (20da6e48c8ebd7e17f68308b0bc45e977ff80471)

Author	SHA1	Message	Date
Jiarui Fang	ae7d3f4927	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2022-07-06 16:15:16 +08:00
Jiarui Fang	060b917daf	[refactor] remove gpc dependency in colotensor's _ops (#1189)	2022-07-04 18:54:37 +08:00
Jiarui Fang	aa7bef73d4	[Tensor] distributed view supports inter-process hybrid parallel (#1169)	2022-06-27 09:45:26 +08:00
Jiarui Fang	4b9bba8116	[ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168)	2022-06-24 13:08:54 +08:00
Jiarui Fang	f4ef224358	[Tensor] remove ParallelAction, use ComputeSpec instread (#1166)	2022-06-23 17:34:59 +08:00
Jiarui Fang	49832b2344	[refactory] add nn.parallel module (#1068)	2022-06-06 15:34:41 +08:00
Ziyue Jiang	df9dcbbff6	[Tensor] add hybrid device demo and fix bugs (#1059)	2022-06-03 12:09:49 +08:00
ver217	cefc29ff06	[tensor] impl ColoDDP for ColoTensor (#1009) ... * impl ColoDDP for ColoTensor * polish code	2022-05-21 13:52:04 +08:00
ver217	a3b66f6def	[tensor] refactor parallel action (#1007) ... * refactor parallel action * polish unit tests	2022-05-20 20:19:58 +08:00
ver217	8e3d0ad8f1	[unit test] refactor test tensor (#1005) ... * polish test_gpt * update op unit tests * update test model	2022-05-19 18:57:56 +08:00
ver217	ad536e308e	[tensor] refactor colo-tensor (#992) ... * refactor colo-tensor and update linear op * polish code * polish code * update ops and unit tests * update unit tests * polish code * rename dist_spec module * polish code * polish code * remove unneeded import * fix pipelinable	2022-05-19 12:44:59 +08:00