github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai/nn/loss/__init__.py

2 lines
51 B
Python
Raw Normal View History

Added MoE parallel (#127)
2022-01-07 07:08:36 +00:00
from .loss_moe import MoeCrossEntropyLoss, MoeLoss