ColossalAI/colossalai/nn/layer/vanilla/__init__.py

from .layers import (DropPath, VanillaClassifier, VanillaLayerNorm, VanillaPatchEmbedding, WrappedDropout,
                     WrappedDropPath)

__all__ = [
    "VanillaLayerNorm", "VanillaPatchEmbedding", "VanillaClassifier", "DropPath", "WrappedDropout", "WrappedDropPath"
]
[NFC] polish colossalai/nn/layer/vanilla/__init__.py code style (#1293) 2022-07-13 03:15:21 +00:00			`from .layers import (DropPath, VanillaClassifier, VanillaLayerNorm, VanillaPatchEmbedding, WrappedDropout,`
			`WrappedDropPath)`
Layer integration (#83) * integrated parallel layers for ease of building models * integrated 2.5d layers * cleaned codes and unit tests * added log metric by step hook; updated imagenet benchmark; fixed some bugs * reworked initialization; cleaned codes Co-authored-by: BoxiangW <45734921+BoxiangW@users.noreply.github.com> 2021-12-27 07:04:32 +00:00
[TP] allow layernorm without bias (#750) 2022-04-14 03:43:56 +00:00			`__all__ = [`
[NFC] polish colossalai/nn/layer/vanilla/__init__.py code style (#1293) 2022-07-13 03:15:21 +00:00			`"VanillaLayerNorm", "VanillaPatchEmbedding", "VanillaClassifier", "DropPath", "WrappedDropout", "WrappedDropPath"`
[TP] allow layernorm without bias (#750) 2022-04-14 03:43:56 +00:00			`]`