github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/moe/__init__.py

6 lines
67 B
Python
Raw Normal View History

[moe] init mixtral impl
2023-12-14 09:52:05 +00:00
from .manager import MOE_MANAGER
[moe] merge moe into main (#4978) * update moe module * support openmoe
2023-11-02 02:21:24 +00:00
__all__ = [
[moe] init mixtral impl
2023-12-14 09:52:05 +00:00
"MOE_MANAGER",
[moe] merge moe into main (#4978) * update moe module * support openmoe
2023-11-02 02:21:24 +00:00
]