You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
ColossalAI/model_zoo
ver217 d70f43dd7a
embedding remove attn mask (#474)
3 years ago
..
gpt embedding remove attn mask (#474) 3 years ago
moe [MOE] add unitest for MOE experts layout, gradient handler and kernel (#469) 3 years ago
vit added gpt model & benchmark (#95) 3 years ago
__init__.py Develop/experiments (#59) 3 years ago
helper.py Added MoE parallel (#127) 3 years ago