You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Kirigaya Kazuto f1e1836218 [pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP (#1508) ... * support p2p communication with any type of object | pass test * reconstruct pipeline schedule with p2p_v2.py(support communication with List[Any]) | pass test * [engin/schedule] use p2p_v2 to recontruct pipeline_schedule * [pipeline/rpc] implement a demo for PP with cuda rpc framework * [pipeline/rpc] support interleaving | fix checkpoint bug | change logic when dispatch data in work_list to ensure steady 1F1B * [pipeline/rpc] implement distributed optimizer | test with assert_close * [pipeline/rpc] implement distributed optimizer | test with assert_close * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/rpc] update outstanding mechanism | optimize dispatching strategy * [pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP * [pipeline/pipleline_process_group] remove comment * [pipeline/pipleline_process_group] remove comment * [pipeline/pipleline_process_group] skip process group test * [pipeline/pipleline_process_group] remove test named function		2 years ago
..
rpc_test_utils.py	[pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP (#1508)	2 years ago
test_cuda_rpc_optimizer.py	[pipeline/rpc] update outstanding mechanism | optimize dispatching strategy (#1497)	2 years ago
test_cuda_rpc_pipeline.py	[pipeline/rpc] update outstanding mechanism | optimize dispatching strategy (#1497)	2 years ago
test_cuda_rpc_value_correctness.py	[pipeline/rpc] update outstanding mechanism | optimize dispatching strategy (#1497)	2 years ago
test_pipelinable.py	[pipeline] refactor the pipeline module (#1087)	2 years ago
test_pipeline_process_group.py	[pipeline/pipleline_process_group] finish PipelineProcessGroup to manage local abd global rank in TP,DP and PP (#1508)	2 years ago