You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

ver217 96780e6ee4 Optimize pipeline schedule (#94) ... * add pipeline shared module wrapper and update load batch * added model parallel process group for amp and clip grad (#86) * added model parallel process group for amp and clip grad * update amp and clip with model parallel process group * remove pipeline_prev/next group (#88) * micro batch offload * optimize pipeline gpu memory usage * pipeline can receive tensor shape (#93) * optimize pipeline gpu memory usage * fix grad accumulation step counter * rename classes and functions Co-authored-by: Frank Lee <somerlee.9@gmail.com>		3 years ago
..
_static/css	Migrated project	3 years ago
_templates/apidoc	Migrated project	3 years ago
colossalai	update examples and sphnix docs for the new api (#63)	3 years ago
Makefile	Migrated project	3 years ago
add_your_parallel.md	Optimize pipeline schedule (#94)	3 years ago
add_your_parallel_zh.md	Optimize pipeline schedule (#94)	3 years ago
amp.md	update examples and sphnix docs for the new api (#63)	3 years ago
amp_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
conf.py	use env to control the language of doc (#24) (#25)	3 years ago
config.md	update examples and sphnix docs for the new api (#63)	3 years ago
config_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
index.rst	use env to control the language of doc (#24) (#25)	3 years ago
index_zh.rst	use env to control the language of doc (#24) (#25)	3 years ago
installation.md	update examples and sphnix docs for the new api (#63)	3 years ago
installation_zh.md	added Chinese documents and fixed some typos in English documents	3 years ago
make.bat	Migrated project	3 years ago
model.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
model_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
parallelization.md	add interleaved pipeline, fix naive amp and update pipeline model initializer (#80)	3 years ago
parallelization_zh.md	fixed some typos in the documents, added blog link and paper author information in README	3 years ago
run_demo.md	update examples and sphnix docs for the new api (#63)	3 years ago
run_demo_zh.md	Develop/experiments (#59)	3 years ago
trainer_engine.md	update markdown docs (english) (#60)	3 years ago
trainer_engine_zh.md	Develop/experiments (#59)	3 years ago
zero.md	update examples and sphnix docs for the new api (#63)	3 years ago
zero_zh.md	fix zero3 fp16 and add zero3 model context (#62)	3 years ago