Jianghai a88e92251d [pipeline] add chatglm (#4363) ... * add pipeline policy and bert forward to be done * add bertmodel pipeline forward and make tests * add Bert_Policy and test for policy * update formatting * update formatting * update the code * fix bugs * fix name confilt * add bloom model and policy ,revise the base class of policy * revise * revision * add bert_for_pretraining * add bert_for_pretraining forward and policy * fix typos * cancel warning * change the imediate output to default dict * change the default output of get_shared_params * add chatglm * add * chatglm * chatglm * finish chatglm * deletes * fix rmsnorm * chatglm * fix chatglm shard * init		2023-08-15 23:25:14 +08:00
..
test_schedule	[pipeline] add unit test for 1f1b (#4303)	2023-08-15 23:25:14 +08:00
rpc_test_utils.py	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_cuda_rpc_chimera.py	…
test_cuda_rpc_optimizer.py	…
test_cuda_rpc_performance.py	…
test_cuda_rpc_pipeline.py	…
test_cuda_rpc_value_correctness.py	…
test_middleware_1f1b.py	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_p2p_communication.py	[pipeline] implement p2p communication (#4100)	2023-08-15 23:25:14 +08:00
test_pipelinable.py	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_pipeline_process_group.py	[test] refactor tests with spawn (#3452)	2023-04-06 14:51:35 +08:00
test_stage_manager.py	[pipeline]add pipeline policy and bert forward (#4130)	2023-08-15 23:25:14 +08:00