ColossalAI/model_zoo
HELSON 7544347145
[MOE] add unitest for MOE experts layout, gradient handler and kernel (#469)
2022-03-21 13:35:04 +08:00
..
gpt fix attn mask shape of gpt (#472) 2022-03-21 12:01:31 +08:00
moe [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 2022-03-21 13:35:04 +08:00
vit added gpt model & benchmark (#95) 2021-12-30 14:43:30 +08:00
__init__.py Develop/experiments (#59) 2021-12-09 15:08:29 +08:00
helper.py Added MoE parallel (#127) 2022-01-07 15:08:36 +08:00