mirror of https://github.com/hpcaitech/ColossalAI
0ceec8f9a9
* add naive optimizer for 3DPlugin/refactor gpt2 shardformer test * merge tests of PP/DP/TP combinations into one test file * fix bug when sync grad for dp in HybridPlugin * update supported precisions for 3DPlugin/fix bug when shifting tp_degree * improve the passing of lazy_init * modify lazy_init/use sync_shared_params |
||
|---|---|---|
| .. | ||
| d_tensor | ||
| __init__.py | ||
| colo_parameter.py | ||
| colo_tensor.py | ||
| comm_spec.py | ||
| compute_spec.py | ||
| const.py | ||
| dist_spec_mgr.py | ||
| distspec.py | ||
| op_wrapper.py | ||
| param_op_hook.py | ||
| process_group.py | ||
| shape_consistency.py | ||
| sharding_spec.py | ||
| tensor_spec.py | ||
| utils.py | ||