ver217
e67dab92a9
add some details in vit-b16 example ( #43 ) ( #44 )
3 years ago
binmakeswell
2528adc62f
add explanation for ViT example ( #35 ) ( #36 )
3 years ago
ver217
dbe62c67b8
add an example of ViT-B/16 and remove w_norm clipping in LAMB ( #29 )
3 years ago
Frank Lee
3defa32aee
Support TP-compatible Torch AMP and Update trainer API ( #27 )
...
* Add gradient accumulation, fix lr scheduler
* fix FP16 optimizer and adapted torch amp with tensor parallel (#18 )
* fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes
* fixed trainer
* Revert "fixed trainer"
This reverts commit 2e0b0b7699
.
* improved consistency between trainer, engine and schedule (#23 )
Co-authored-by: 1SAA <c2h214748@gmail.com>
Co-authored-by: 1SAA <c2h214748@gmail.com>
Co-authored-by: ver217 <lhx0217@gmail.com>
3 years ago
ver217
2b05de4c64
use env to control the language of doc ( #24 ) ( #25 )
3 years ago
ver217
9942fd5bfa
remove redundancy func in setup ( #19 ) ( #20 )
3 years ago
ver217
0aa07e600c
Merge pull request #15 from hpcaitech/feature/zhdoc
...
made some modifications to the documents
3 years ago
binmakeswell
05e7069a5b
fixed some typos in the documents, added blog link and paper author information in README
3 years ago
Frank Lee
ccb44882e1
Merge pull request #10 from hpcaitech/feature/zhdoc
...
added Chinese documents and fixed some typos in English documents
3 years ago
Fan Cui
18ba66e012
added Chinese documents and fixed some typos in English documents
3 years ago
Frank Lee
ccbc918c11
Merge pull request #4 from hpcaitech/hotfix/doc
...
reoder parallelization methods in parallelization documentation
3 years ago
ver217
50982c0b7d
reoder parallelization methods in parallelization documentation
3 years ago
ver217
3c7604ba30
update documentation
3 years ago
アマデウス
3245a69fc2
cleaned test scripts
3 years ago
アマデウス
da2042f5c1
updated readme
3 years ago
zbian
404ecbdcc6
Migrated project
3 years ago
アマデウス
2ebaefc542
Initial commit
3 years ago