Commit Graph

2581 Commits (16bf4c022150fea303d23437b0190c46204e722c)
 

Author SHA1 Message Date
アマデウス 0fedef4f3c
Layer integration (#83)
3 years ago
shenggan 5c3843dc98
add colossalai kernel module (#55)
3 years ago
Xin Zhang 648f806315
add example of self-supervised SimCLR training - V2 (#50)
3 years ago
ver217 8f02a88db2
add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)
3 years ago
Frank Lee 91c327cb44
fixed zero level 3 dtype bug (#76)
3 years ago
HELSON 632e622de8
overlap computation and communication in 2d operations (#75)
3 years ago
Frank Lee cd9c28e055
added CI for unit testing (#69)
3 years ago
Frank Lee 45355a62f7
Update issue templates (#66)
3 years ago
Frank Lee 35813ed3c4
update examples and sphnix docs for the new api (#63)
3 years ago
ver217 7d3711058f
fix zero3 fp16 and add zero3 model context (#62)
3 years ago
Frank Lee 9a0466534c
update markdown docs (english) (#60)
3 years ago
Frank Lee da01c234e1
Develop/experiments (#59)
3 years ago
ver217 eb2f8b1f6b
add how to build tfrecord dataset (#48)
3 years ago
ver217 4da256a584
add some details in vit-b16 example (#46)
3 years ago
ver217 e67dab92a9
add some details in vit-b16 example (#43) (#44)
3 years ago
binmakeswell 2528adc62f
add explanation for ViT example (#35) (#36)
3 years ago
ver217 dbe62c67b8
add an example of ViT-B/16 and remove w_norm clipping in LAMB (#29)
3 years ago
Frank Lee 3defa32aee
Support TP-compatible Torch AMP and Update trainer API (#27)
3 years ago
ver217 2b05de4c64
use env to control the language of doc (#24) (#25)
3 years ago
ver217 9942fd5bfa
remove redundancy func in setup (#19) (#20)
3 years ago
ver217 0aa07e600c
Merge pull request #15 from hpcaitech/feature/zhdoc
3 years ago
binmakeswell 05e7069a5b fixed some typos in the documents, added blog link and paper author information in README
3 years ago
Frank Lee ccb44882e1
Merge pull request #10 from hpcaitech/feature/zhdoc
3 years ago
Fan Cui 18ba66e012 added Chinese documents and fixed some typos in English documents
3 years ago
Frank Lee ccbc918c11
Merge pull request #4 from hpcaitech/hotfix/doc
3 years ago
ver217 50982c0b7d reoder parallelization methods in parallelization documentation
3 years ago
ver217 3c7604ba30 update documentation
3 years ago
アマデウス 3245a69fc2
cleaned test scripts
3 years ago
アマデウス da2042f5c1
updated readme
3 years ago
zbian 404ecbdcc6 Migrated project
3 years ago
アマデウス 2ebaefc542
Initial commit
3 years ago