mirror of https://github.com/hpcaitech/ColossalAI
c5ea728016
* add pipeline policy and bert forward to be done * add bertmodel pipeline forward and make tests * add Bert_Policy and test for policy * update formatting * update formatting * update the code * fix bugs * fix name confilt * add bloom model and policy ,revise the base class of policy * revise * revision * add bert_for_pretraining * add bert_for_pretraining forward and policy * fix typos * cancel warning * change the imediate output to default dict * change the default output of get_shared_params |
||
|---|---|---|
| .. | ||
| test_bert_for_pretraining_model.py | ||
| test_bert_lmhead_model.py | ||
| test_bert_model.py | ||
| test_bloom_model.py | ||