アマデウス 9ee197d0e9 moved env variables to global variables; (#215) ... added branch context; added vocab parallel layers; moved split_batch from load_batch to tensor parallel embedding layers; updated gpt model; updated unit test cases; fixed few collective communicator bugs		2022-02-15 11:31:13 +08:00
..
bert	Develop/experiments (#59)	2021-12-09 15:08:29 +08:00
gpt	moved env variables to global variables; (#215)	2022-02-15 11:31:13 +08:00
mlp_mixer	Develop/experiments (#59)	2021-12-09 15:08:29 +08:00
moe	Added moe parallel example (#140)	2022-01-17 15:34:04 +08:00
vit	added gpt model & benchmark (#95)	2021-12-30 14:43:30 +08:00
__init__.py	Develop/experiments (#59)	2021-12-09 15:08:29 +08:00
helper.py	Added MoE parallel (#127)	2022-01-07 15:08:36 +08:00