ColossalAI

Author	SHA1	Message	Date
ver217	8f02a88db2	add interleaved pipeline, fix naive amp and update pipeline model initializer (#80 )	2021-12-20 23:26:19 +08:00
Frank Lee	9a0466534c	update markdown docs (english) (#60 )	2021-12-10 14:37:33 +08:00
Frank Lee	3defa32aee	Support TP-compatible Torch AMP and Update trainer API (#27 ) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit `2e0b0b7699`. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>	2021-11-18 19:45:06 +08:00
binmakeswell	05e7069a5b	fixed some typos in the documents, added blog link and paper author information in README	2021-11-03 17:18:43 +08:00
Fan Cui	18ba66e012	added Chinese documents and fixed some typos in English documents	2021-11-02 23:28:44 +08:00
ver217	50982c0b7d	reoder parallelization methods in parallelization documentation	2021-11-01 14:31:55 +08:00
zbian	404ecbdcc6	Migrated project	2021-10-28 18:21:23 +02:00