mirror of https://github.com/hpcaitech/ColossalAI
c5ea728016
* add pipeline policy and bert forward to be done * add bertmodel pipeline forward and make tests * add Bert_Policy and test for policy * update formatting * update formatting * update the code * fix bugs * fix name confilt * add bloom model and policy ,revise the base class of policy * revise * revision * add bert_for_pretraining * add bert_for_pretraining forward and policy * fix typos * cancel warning * change the imediate output to default dict * change the default output of get_shared_params |
||
|---|---|---|
| .. | ||
| middleware | ||
| policy | ||
| rpc | ||
| schedule | ||
| __init__.py | ||
| layer_spec.py | ||
| p2p.py | ||
| pipelinable.py | ||
| pipeline_process_group.py | ||
| stage_manager.py | ||
| utils.py | ||