mirror of https://github.com/hpcaitech/ColossalAI
a30e2b4c24
only process module's own parameters in Zero context add zero hooks for all modules that contrain parameters gather parameters only belonging to module itself |
||
|---|---|---|
| .. | ||
| components_to_test | ||
| test_amp | ||
| test_comm | ||
| test_config | ||
| test_context | ||
| test_data | ||
| test_data_pipeline_tensor_parallel | ||
| test_engine | ||
| test_layers | ||
| test_moe | ||
| test_optimizer | ||
| test_trainer | ||
| test_utils | ||
| test_zero_data_parallel | ||
| __init__.py | ||