ColossalAI/colossalai/tensor
Wenhao Chen 3c08f17348
[hotfix]: modify create_ep_hierarchical_group and add test (#5032)
* feat: modify create_ep_hierarchical_group args

* test: add ep tests

* fix: remove get_process_group_ranks

* fix: fix src_rank
2023-11-17 10:53:00 +08:00
..
d_tensor [gemini] gemini support tensor parallelism. (#4942) 2023-11-10 10:15:16 +08:00
moe_tensor [hotfix]: modify create_ep_hierarchical_group and add test (#5032) 2023-11-17 10:53:00 +08:00
__init__.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
colo_parameter.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
colo_tensor.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
comm_spec.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
param_op_hook.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
shape_consistency.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
sharding_spec.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00
utils.py [misc] update pre-commit and run all files (#4752) 2023-09-19 14:20:26 +08:00