ColossalAI/colossalai/nn/layer
FoolPlayer ab8a47f830 [shardformer] add Dropout layer support different dropout pattern (#3856)
* add dropout layer, add dropout test

* modify seed manager as context manager

* add a copy of col_nn.layer

* add dist_crossentropy loss; separate module test

* polish the code

* fix dist crossentropy loss
2023-07-04 16:05:01 +08:00
..
colossalai_layer
moe
parallel_1d [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-07-04 16:05:01 +08:00
parallel_2d
parallel_2p5d
parallel_3d
parallel_sequence [nfc] fix typo colossalai/nn (#3887) 2023-06-05 16:04:27 +08:00
utils
vanilla
wrapper
__init__.py
base_layer.py [format] applied code formatting on changed files in pull request 4021 (#4022) 2023-06-19 11:23:24 +08:00