Jiarui Fang 1aad903c15 [tensor] redistribute among different process groups (#1247) ... * make it faster * [tensor] rename convert_to_dist -> redistribute * [tensor] ShardSpec and ReplicaSpec * [tensor] redistribute among diff pgs * polish code		2022-07-12 10:24:05 +08:00
..
_ops	[tensor] redistribute among different process groups (#1247)	2022-07-12 10:24:05 +08:00
graph	[refactor] move process group from _DistSpec to ColoTensor. (#1203)	2022-07-06 16:15:16 +08:00
layer	[pipeline] refactor the pipeline module (#1087)	2022-06-10 11:27:38 +08:00
loss	[tensor] add unitest for colo_tensor 1DTP cross_entropy (#1230)	2022-07-07 19:17:23 +08:00
lr_scheduler	[checkpoint]support generalized scheduler (#1222)	2022-07-07 18:16:38 +08:00
metric	[hotfix] Raise messages for indivisible batch sizes with tensor parallelism (#622)	2022-04-02 16:12:04 +08:00
optimizer	[optim] refactor fused sgd (#1134)	2022-06-20 11:19:38 +08:00
parallel	[tensor] a shorter shard and replicate spec (#1245)	2022-07-11 15:51:48 +08:00
__init__.py	[pipeline] refactor the pipeline module (#1087)	2022-06-10 11:27:38 +08:00
init.py	Refactored docstring to google style	2022-03-29 17:17:47 +08:00