ColossalAI

46 Tags

236 MiB

Tree: dec24561cf

Author	SHA1	Message	Date
ver217	578ea0583b	update setup and workflow (#222 )	3 years ago
BoxiangW	a2f1565672	Update GitHub action and pre-commit settings (#196 ) * Update GitHub action and pre-commit settings * Update GitHub action and pre-commit settings (#198)	3 years ago
Frank Lee	3defa32aee	Support TP-compatible Torch AMP and Update trainer API (#27 ) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit `2e0b0b7699`. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>	3 years ago
zbian	404ecbdcc6	Migrated project	3 years ago