Commit Graph

2 Commits (13ed4b64411d97a58bf8cb481ef45aef0f7d00f9)

Author SHA1 Message Date
HELSON dceae85195
Added MoE parallel (#127) 2022-01-07 15:08:36 +08:00
アマデウス 0fedef4f3c
Layer integration (#83)
* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 15:04:32 +08:00