github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/docs
History
Frank Lee 3defa32aee
Support TP-compatible Torch AMP and Update trainer API (#27) 
* Add gradient accumulation, fix lr scheduler

* fix FP16 optimizer and adapted torch amp with tensor parallel (#18)

* fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

* fixed trainer

* Revert "fixed trainer"

This reverts commit 2e0b0b7699.

* improved consistency between trainer, engine and schedule (#23)

Co-authored-by: 1SAA <c2h214748@gmail.com>

Co-authored-by: 1SAA <c2h214748@gmail.com>
Co-authored-by: ver217 <lhx0217@gmail.com>
 		2021-11-18 19:45:06 +08:00
..
_static/css Migrated project 2021-10-28 18:21:23 +02:00
_templates/apidoc Migrated project 2021-10-28 18:21:23 +02:00
colossalai Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
Makefile Migrated project 2021-10-28 18:21:23 +02:00
add_your_parallel.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
add_your_parallel_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
amp.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
amp_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
conf.py use env to control the language of doc (#24) (#25) 2021-11-15 16:53:56 +08:00
config.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
config_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
index.rst use env to control the language of doc (#24) (#25) 2021-11-15 16:53:56 +08:00
index_zh.rst use env to control the language of doc (#24) (#25) 2021-11-15 16:53:56 +08:00
installation.md Migrated project 2021-10-28 18:21:23 +02:00
installation_zh.md added Chinese documents and fixed some typos in English documents 2021-11-02 23:28:44 +08:00
make.bat Migrated project 2021-10-28 18:21:23 +02:00
model.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
model_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
parallelization.md Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
parallelization_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
run_demo.md Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
run_demo_zh.md Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
trainer_engine.md Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
trainer_engine_zh.md Support TP-compatible Torch AMP and Update trainer API (#27) 2021-11-18 19:45:06 +08:00
zero.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00
zero_zh.md fixed some typos in the documents, added blog link and paper author information in README 2021-11-03 17:18:43 +08:00