Jianghai 90a65ea682 [pipeline] build bloom model and policy , revise the base class of policy (#4161) ... * add pipeline policy and bert forward to be done * add bertmodel pipeline forward and make tests * add Bert_Policy and test for policy * update formatting * update formatting * update the code * fix bugs * fix name confilt * add bloom model and policy ,revise the base class of policy * revise * revision * add bert_for_pretraining		2023-08-15 23:25:14 +08:00
..
middleware	[Pipeline Middleware] Adapt scheduler for Topo (#2066)	2022-12-05 20:23:41 +08:00
policy	[pipeline] build bloom model and policy , revise the base class of policy (#4161)	2023-08-15 23:25:14 +08:00
rpc	[nfc]fix typo colossalai/pipeline tensor nn (#3899)	2023-06-06 14:07:36 +08:00
schedule	[pipeline] refactor 1f1b schedule (#4115)	2023-08-15 23:25:14 +08:00
__init__.py	fix file name (#1759)	2022-10-25 16:48:48 +08:00
layer_spec.py	fix file name (#1759)	2022-10-25 16:48:48 +08:00
p2p.py	[pipeline] implement p2p communication (#4100)	2023-08-15 23:25:14 +08:00
pipelinable.py	[nfc]fix typo colossalai/pipeline tensor nn (#3899)	2023-06-06 14:07:36 +08:00
pipeline_process_group.py	[pipeline/fix-bug] num_microbatches support any integrate | stable chimera | launch tool for rpc pp framework (#1684)	2022-10-10 16:01:02 +08:00
stage_manager.py	[pipeline] add stage manager (#4093)	2023-08-15 23:25:14 +08:00
utils.py	[nfc]fix typo colossalai/pipeline tensor nn (#3899)	2023-06-06 14:07:36 +08:00