mirror of https://github.com/hpcaitech/ColossalAI
e7d3afc9cc
* [optimizer] add div_scale for optimizers * [zero] use div_scale in zero optimizer * fix testing error |
||
---|---|---|
.. | ||
_C | ||
amp | ||
auto_parallel | ||
builder | ||
cli | ||
communication | ||
context | ||
device | ||
engine | ||
fx | ||
gemini | ||
kernel | ||
logging | ||
nn | ||
pipeline | ||
registry | ||
tensor | ||
testing | ||
trainer | ||
utils | ||
zero | ||
__init__.py | ||
constants.py | ||
core.py | ||
global_variables.py | ||
initialize.py |