2635 Commits (c59d7aca095d205df404c0c6e831e7ae33b785f1)
 

Author SHA1 Message Date
Kun Lin c59d7aca09 Feature/vit support (#4182) 1 year ago
Baizhou Zhang 0ceec8f9a9 [pipeline] support fp32 for HybridPlugin/merge shardformer test and pipeline test into one file (#4354) 1 year ago
Jianghai f13954cd58 [pipeline] refactor test pipeline and remove useless utils in pipeline (#4324) 1 year ago
LuGY d3c6cd66f3 [pipeline] add unit test for 1f1b (#4303) 1 year ago
Baizhou Zhang da3cef27ad [pipeline] fix return_dict/fix pure_pipeline_test (#4331) 1 year ago
Hongxin Liu 411cf1d2db [hotfix] fix gemini and zero test (#4333) 1 year ago
Hongxin Liu 261eab02fb [plugin] add 3d parallel plugin (#4295) 1 year ago
FoolPlayer b3f5d7a3ba [shardformer] support pipeline base vit model (#4284) 1 year ago
Baizhou Zhang 083d7da33d [pipeline] add pipeline support for all T5 models (#4310) 1 year ago
Jianghai d0807122e2 [pipeline] test pure pipeline process using llama (#4218) 1 year ago
Baizhou Zhang 36e546b2cc [pipeline] add pipeline support for T5Stack/T5EncoderModel (#4300) 1 year ago
Jianghai 18ebcf406a [pipeline] reformat for unified design (#4283) 1 year ago
Jianghai 0a8f3c851a [hotfix] fix opt pipeline (#4293) 1 year ago
Jianghai d8408d185c [pipeline] OPT model pipeline (#4258) 1 year ago
Baizhou Zhang b774d5ea0f [pipeline] refactor gpt2 pipeline forwards (#4287) 1 year ago
Hongxin Liu d921ce8391 [shardformer] support inplace sharding (#4251) 1 year ago
Baizhou Zhang 2a2eacfaf1 [pipeline] support shardformer for GPT2ForQuestionAnswering & complete pipeline support for GPT2 (#4245) 1 year ago
Jianghai d9be0472ef [bugs] hot fix some testing bugs for new models (#4268) 1 year ago
Jianghai 34f0e34a4c [pipeline] finish bloom models pipeline and tests (#4223) 1 year ago
Jianghai e7cc62d735 [pipeline] All bert models (#4233) 1 year ago
Baizhou Zhang a14d352088 [pipeline] add pipeline forward for variants of gpt2 (#4238) 1 year ago
Hongxin Liu 7e4de520e1 [shardformer] fix base policy (#4229) 1 year ago
Baizhou Zhang 208ac8f2ba [pipeline] Add Pipeline Forward for GPT2Model Shardformer (#4224) 1 year ago
Jianghai 37d22f6878 [pipeline] add bloom model pipeline (#4210) 1 year ago
Jianghai 31bcf867ae [pipeline] Llama causal lm and llama for sequence classification pipeline (#4208) 1 year ago
Jianghai 1622031058 [pipeline] Llama pipeline (#4205) 1 year ago
Jianghai 1094e0f0d3 [pipeline] Bert pipeline for shardformer and its tests (#4197) 1 year ago
Hongxin Liu 890774b2fb [shardformer] support lazy init (#4202) 1 year ago
Jianghai f3bcc292c8 [pipeline] move bert related pipeline components to shardformer (#4187) 1 year ago
Jianghai c5ea728016 [pipeline] add bert_for_pretraining bert_lmhead forward and policy (#4172) 1 year ago
ver217 d35bd7d0e6 [shardformer] fix type hint 1 year ago
ver217 1ed3f8a24f [shardformer] rename policy file name 1 year ago
ver217 5fc60a3a04 [test] add shard util tests 1 year ago
ver217 2d6cc07feb [test] update shardformer tests 1 year ago
ver217 b0b8ad2823 [pipeline] update shardformer docstring 1 year ago
ver217 59f6f573f1 [pipeline] update shardformer policy 1 year ago
Jianghai 90a65ea682 [pipeline] build bloom model and policy , revise the base class of policy (#4161) 1 year ago
Jianghai c552cefa93 [pipeline]add pipeline policy and bert forward (#4130) 1 year ago
Hongxin Liu 5c897ddb94 [pipeline] add stage manager (#4093) 1 year ago
Jianghai e8e7e49243 [pipeline]add pipeline policy and bert forward (#4130) 1 year ago
Hongxin Liu f51ce1bc8e [pipeline] refactor 1f1b schedule (#4115) 1 year ago
Hongxin Liu 45fdc9b42c [pipeline] implement p2p communication (#4100) 1 year ago
Hongxin Liu 422544222f [pipeline] add stage manager (#4093) 1 year ago
Hongxin Liu 5e1a9d48dd [cluster] add process group mesh (#4039) 1 year ago
Tian Siyuan ff836790ae
[doc] fix a typo in examples/tutorial/auto_parallel/README.md (#4430) 1 year ago
Wenhao Chen 6d41c3f2aa
[doc] update Coati README (#4405) 1 year ago
LuGY d86ddd9b29
[hotfix] fix unsafe async comm in zero (#4404) 1 year ago
Baizhou Zhang 6ccecc0c69
[gemini] fix tensor storage cleaning in state dict collection (#4396) 1 year ago
flybird1111 458ae331ad
[kernel] updated unittests for coloattention (#4389) 1 year ago
binmakeswell 089c365fa0
[doc] add Series A Funding and NeurIPS news (#4377) 1 year ago