ColossalAI

Commit Graph

Author	SHA1	Message	Date
HELSON	abba4d84e1	[hotfix] fix bert model test in unitests (#1272 )	2022-07-12 23:26:45 +08:00
Jiarui Fang	9bcd2fd4af	[tensor] a shorter shard and replicate spec (#1245 )	2022-07-11 15:51:48 +08:00
Jiarui Fang	ae7d3f4927	[refactor] move process group from _DistSpec to ColoTensor. (#1203 )	2022-07-06 16:15:16 +08:00
Jiarui Fang	060b917daf	[refactor] remove gpc dependency in colotensor's _ops (#1189 )	2022-07-04 18:54:37 +08:00
Jiarui Fang	4b9bba8116	[ColoTensor] rename APIs and add output_replicate to ComputeSpec (#1168 )	2022-06-24 13:08:54 +08:00
Jiarui Fang	f4ef224358	[Tensor] remove ParallelAction, use ComputeSpec instread (#1166 )	2022-06-23 17:34:59 +08:00
ver217	a3b66f6def	[tensor] refactor parallel action (#1007 ) * refactor parallel action * polish unit tests	2022-05-20 20:19:58 +08:00
ver217	8e3d0ad8f1	[unit test] refactor test tensor (#1005 ) * polish test_gpt * update op unit tests * update test model	2022-05-19 18:57:56 +08:00
ver217	ad536e308e	[tensor] refactor colo-tensor (#992 ) * refactor colo-tensor and update linear op * polish code * polish code * update ops and unit tests * update unit tests * polish code * rename dist_spec module * polish code * polish code * remove unneeded import * fix pipelinable	2022-05-19 12:44:59 +08:00
ver217	c2fdc6a011	[tensor] derive compute pattern from dist spec (#971 ) * derive compute pattern from dist spec * polish code	2022-05-16 14:58:08 +08:00
ver217	67c33f57eb	[tensor] design DistSpec and DistSpecManager for ColoTensor (#934 ) * add dist spec * update linear op * polish code * polish code * update embedding op * polish unit tests * polish unit tests * polish comments * polish code * add test_dist_spec_mgr * polish code * refactor folder structure * polish unit tests * add get_process_group() for TensorSpec * polish code	2022-05-13 15:13:52 +08:00
Ziyue Jiang	193d629311	update pytest.mark.parametrize in tensor tests (#913 )	2022-05-06 11:16:40 +08:00
Ziyue Jiang	f593a5637e	[Tensor] add embedding tp1d row (#904 )	2022-04-29 14:10:05 +08:00
Ziyue Jiang	2c0d19d755	[Tensor] add ColoTensor TP1Dcol Embedding (#899 )	2022-04-28 17:45:06 +08:00

14 Commits (f8b9aaef47d5a2b66db87b5d2b093639a66a131f)