Commit Graph

15 Commits (af88570f4b848431bc766607bc59db8b28da95a6)

Author SHA1 Message Date
Frank Lee af88570f4b fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes 2021-11-10 10:47:58 +08:00
ver217 c8cb9f9e34
fix FP16 optimizer and adapted torch amp with tensor parallel (#18) 2021-11-08 16:47:32 +08:00
Frank Lee 26dce0a898
Merge pull request #17 from 1SAA/main
Add gradient accumulation, fix lr scheduler
2021-11-08 16:39:27 +08:00
1SAA 8aa21d6bc5 Add gradient accumulation, fix lr scheduler 2021-11-08 16:30:24 +08:00
ver217 0aa07e600c
Merge pull request #15 from hpcaitech/feature/zhdoc
made some modifications to the documents
2021-11-04 14:26:28 +08:00
binmakeswell 05e7069a5b fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
Frank Lee ccb44882e1
Merge pull request #10 from hpcaitech/feature/zhdoc
added Chinese documents and fixed some typos in English documents
2021-11-03 11:38:06 +08:00
Fan Cui 18ba66e012 added Chinese documents and fixed some typos in English documents 2021-11-02 23:28:44 +08:00
Frank Lee ccbc918c11
Merge pull request #4 from hpcaitech/hotfix/doc
reoder parallelization methods in parallelization documentation
2021-11-02 14:35:06 +08:00
ver217 50982c0b7d reoder parallelization methods in parallelization documentation 2021-11-01 14:31:55 +08:00
ver217 3c7604ba30 update documentation 2021-10-29 09:29:20 +08:00
アマデウス 3245a69fc2
cleaned test scripts 2021-10-29 00:48:14 +08:00
アマデウス da2042f5c1
updated readme 2021-10-29 00:39:21 +08:00
zbian 404ecbdcc6 Migrated project 2021-10-28 18:21:23 +02:00
アマデウス 2ebaefc542
Initial commit 2021-10-29 00:19:45 +08:00