ColossalAI

Author	SHA1	Message	Date
ver217	ae71036cd2	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548 ) * refactor parallel layer * broadcast rank0 model after load ckpt	2 years ago
ver217	2bed096848	[utils] optimize partition_tensor_parallel_state_dict (#1546 )	2 years ago
ver217	f5d3a9c2b0	polish checkpoint docstring (#637 )	3 years ago
HELSON	055fbf5be6	[zero] adapt zero for unsharded paramters (Optimizer part) (#601 )	3 years ago
アマデウス	acae68eb04	[model checkpoint] updated checkpoint save/load utils (#592 )	3 years ago
ver217	369a288bf3	polish utils docstring (#620 )	3 years ago
Liang Bowen	ec5086c49c	Refactored docstring to google style	3 years ago
Frank Lee	3a1a9820b0	fixed mkdir conflict and align yapf config with flake (#220 )	3 years ago
HELSON	0f8c7f9804	Fixed docstring in colossalai (#171 )	3 years ago
Frank Lee	3defa32aee	Support TP-compatible Torch AMP and Update trainer API (#27 ) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit `2e0b0b7699`. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>	3 years ago