ColossalAI/colossalai/engine
HELSON a30e2b4c24
[zero] adapt for no-leaf module in zero (#535)
only process module's own parameters in Zero context

add zero hooks for all modules that contrain parameters

gather parameters only belonging to module itself
2022-03-28 17:42:18 +08:00
..
gradient_handler [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
ophooks [zero] adapt for no-leaf module in zero (#535) 2022-03-28 17:42:18 +08:00
paramhooks Fix/format colossalai/engine/paramhooks/(#350) 2022-03-11 15:50:28 +08:00
schedule [refactor] remove old zero code (#517) 2022-03-25 14:54:39 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
_base_engine.py set criterion as optional in colossalai initialize (#336) 2022-03-11 15:50:28 +08:00