ColossalAI/colossalai/tensor/moe_tensor
Wenhao Chen 3c08f17348
[hotfix]: modify create_ep_hierarchical_group and add test (#5032)
* feat: modify create_ep_hierarchical_group args

* test: add ep tests

* fix: remove get_process_group_ranks

* fix: fix src_rank
2023-11-17 10:53:00 +08:00
..
__init__.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00
api.py [hotfix]: modify create_ep_hierarchical_group and add test (#5032) 2023-11-17 10:53:00 +08:00
moe_info.py [moe] merge moe into main (#4978) 2023-11-02 02:21:24 +00:00