Commit Graph

2 Commits (ffad81e1d1ce7b450227ec5c5da166361d935ad7)

Author SHA1 Message Date
HELSON dceae85195
Added MoE parallel (#127) 2022-01-07 15:08:36 +08:00
アマデウス 0fedef4f3c
Layer integration (#83)
* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>
2021-12-27 15:04:32 +08:00