ColossalAI

Commit Graph

Author	SHA1	Message	Date
HELSON	dceae85195	Added MoE parallel (#127 )	3 years ago
アマデウス	0fedef4f3c	Layer integration (#83 ) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>	3 years ago

Author

SHA1

Message

Date

HELSON

dceae85195

Added MoE parallel (#127 )

アマデウス

0fedef4f3c

Layer integration (#83 )

* integrated parallel layers for ease of building models

* integrated 2.5d layers

* cleaned codes and unit tests

* added log metric by step hook; updated imagenet benchmark; fixed some bugs

* reworked initialization; cleaned codes

Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com>

2 Commits (578ea0583be9b29ddc6ccb4a69ca5f4fbf215346)