ColossalAI

Commit Graph

Author SHA1 Message Date

Frank Lee 3a1a9820b0 fixed mkdir conflict and align yapf config with flake (#220 ) 2022-02-15 11:31:13 +08:00

Author	SHA1	Message	Date
Frank Lee	3a1a9820b0	fixed mkdir conflict and align yapf config with flake (#220 )	2022-02-15 11:31:13 +08:00
HELSON	0f8c7f9804	Fixed docstring in colossalai (#171 )	2022-01-21 10:44:30 +08:00
Frank Lee	3defa32aee	Support TP-compatible Torch AMP and Update trainer API (#27 ) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit `2e0b0b7699`. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>	2021-11-18 19:45:06 +08:00

HELSON

0f8c7f9804

Fixed docstring in colossalai (#171 )

2022-01-21 10:44:30 +08:00

Frank Lee

3defa32aee

Support TP-compatible Torch AMP and Update trainer API (#27 )

* Add gradient accumulation, fix lr scheduler

* fix FP16 optimizer and adapted torch amp with tensor parallel (#18)

* fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes

* fixed trainer

* Revert "fixed trainer"

This reverts commit 2e0b0b7699.

* improved consistency between trainer, engine and schedule (#23)

Co-authored-by: 1SAA <c2h214748@gmail.com>

Co-authored-by: 1SAA <c2h214748@gmail.com>
Co-authored-by: ver217 <lhx0217@gmail.com>

2021-11-18 19:45:06 +08:00

3 Commits (7d81b5b46ebb1e95d32545122bd86b44dcf54db1)