mirror of https://github.com/hpcaitech/ColossalAI
![]() only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself |
||
---|---|---|
.. | ||
init_ctx | ||
shard_utils | ||
sharded_model | ||
sharded_optim | ||
sharded_param | ||
__init__.py |