You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

Frank Lee 3defa32aee Support TP-compatible Torch AMP and Update trainer API (#27) ... * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b7699. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>		3 years ago
..
_static/css	Migrated project	3 years ago
_templates/apidoc	Migrated project	3 years ago
colossalai	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
Makefile	Migrated project	3 years ago
add_your_parallel.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
add_your_parallel_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
amp.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
amp_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
conf.py	use env to control the language of doc (#24) (#25)	3 years ago
config.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
config_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
index.rst	use env to control the language of doc (#24) (#25)	3 years ago
index_zh.rst	use env to control the language of doc (#24) (#25)	3 years ago
installation.md	Migrated project	3 years ago
installation_zh.md	added Chinese documents and fixed some typos in English documents	3 years ago
make.bat	Migrated project	3 years ago
model.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
model_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
parallelization.md	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
parallelization_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
run_demo.md	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
run_demo_zh.md	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
trainer_engine.md	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
trainer_engine_zh.md	Support TP-compatible Torch AMP and Update trainer API (#27)	3 years ago
zero.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
zero_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago