github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from '214da761d4'
${ noResults }
ColossalAI/requirements/requirements.txt

10 lines
84 B
Raw Normal View History Unescape

Migrated project
3 years ago
torch>=1.8
torchvision>=0.9
numpy
tqdm
psutil
Support TP-compatible Torch AMP and Update trainer API (#27) * Add gradient accumulation, fix lr scheduler * fix FP16 optimizer and adapted torch amp with tensor parallel (#18) * fixed bugs in compatibility between torch amp and tensor parallel and performed some minor fixes * fixed trainer * Revert "fixed trainer" This reverts commit 2e0b0b76990e8d4e337add483d878c0f61cf5097. * improved consistency between trainer, engine and schedule (#23) Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: 1SAA <c2h214748@gmail.com> Co-authored-by: ver217 <lhx0217@gmail.com>
3 years ago
tensorboard
Update GitHub action and pre-commit settings (#196) * Update GitHub action and pre-commit settings * Update GitHub action and pre-commit settings (#198)
3 years ago
packaging
pre-commit
[log] better logging display with rich (#426) * better logger using rich * remove deepspeed in zero requirements
3 years ago
rich