256 Commits (b37797ed3d3d6af294a095397b4bc135264b8c6a)

Author	SHA1	Message	Date
ver217	4da256a584	add some details in vit-b16 example (#46)	3 years ago
ver217	e67dab92a9	add some details in vit-b16 example (#43) (#44)	3 years ago
binmakeswell	2528adc62f	add explanation for ViT example (#35) (#36)	3 years ago
ver217	dbe62c67b8	add an example of ViT-B/16 and remove w_norm clipping in LAMB (#29)	3 years ago
Frank Lee	3defa32aee	Support TP-compatible Torch AMP and Update trainer API (#27) ... * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b7699. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>	3 years ago
zbian	404ecbdcc6	Migrated project	3 years ago