mirror of https://github.com/hpcaitech/ColossalAI
890774b2fb
* [shardformer] support lazy init * [shardformer] linear support lazy init * [shardformer] embedding support lazy init * [shardformer] norm support lazy init * [shardformer] fused linear support lazy init * [test] update shardformer test layer * [test] shardformer with lazy init fit ddp * [lazy] hotfix deepcopy of param * [shardformer] fix bert policy and update test * [shardformer] fix bloom policy and update test * [shardformer] fix opt policy and update test * [shardformer] fix t5 policy and update test * [shardformer] fix gpt2 policy and update test * [shardformer] fix llama policy and update test |
||
|---|---|---|
| .. | ||
| components_to_test | ||
| kit | ||
| test_amp | ||
| test_analyzer | ||
| test_auto_parallel | ||
| test_autochunk | ||
| test_booster | ||
| test_checkpoint_io | ||
| test_cluster | ||
| test_comm | ||
| test_config | ||
| test_context | ||
| test_data | ||
| test_data_pipeline_tensor_parallel | ||
| test_ddp | ||
| test_device | ||
| test_engine | ||
| test_fx | ||
| test_kernels | ||
| test_layers | ||
| test_lazy | ||
| test_moe | ||
| test_ops | ||
| test_optimizer | ||
| test_pipeline | ||
| test_shardformer | ||
| test_tensor | ||
| test_trainer | ||
| test_utils | ||
| test_zero | ||
| __init__.py | ||