mirror of https://github.com/hpcaitech/ColossalAI
![]() * [feature] support no master weights for low level zero plugin * [feature] support no master weights for low level zero plugin, remove data copy when no master weights * remove data copy and typecasting when no master weights * not load weights to cpu when using no master weights * fix grad: use fp16 grad when no master weights * only do not update working param when no master weights * fix: only do not update working param when no master weights * fix: passing params in dict format in hybrid plugin * fix: remove extra params (tp_process_group) in hybrid_parallel_plugin |
||
---|---|---|
.. | ||
mixed_precision | ||
plugin | ||
__init__.py | ||
accelerator.py | ||
booster.py |