ColossalAI/colossalai/nn/layer/vanilla/__init__.py

from .layers import DropPath, VanillaClassifier, VanillaPatchEmbedding, \
    WrappedDropout, WrappedDropPath

__all__ = ['VanillaPatchEmbedding', 'VanillaClassifier', 'DropPath',
           'WrappedDropout', 'WrappedDropPath']
Added MoE parallel (#127) 2022-01-07 07:08:36 +00:00			`from .layers import DropPath, VanillaClassifier, VanillaPatchEmbedding, \`
			`WrappedDropout, WrappedDropPath`
Layer integration (#83) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com> 2021-12-27 07:04:32 +00:00
Added MoE parallel (#127) 2022-01-07 07:08:36 +00:00			`__all__ = ['VanillaPatchEmbedding', 'VanillaClassifier', 'DropPath',`
			`'WrappedDropout', 'WrappedDropPath']`