ColossalAI/colossalai/nn/layer/parallel_1d
FoolPlayer ab8a47f830 [shardformer] add Dropout layer support different dropout pattern (#3856)
* add dropout layer, add dropout test

* modify seed manager as context manager

* add a copy of col_nn.layer

* add dist_crossentropy loss; separate module test

* polish the code

* fix dist crossentropy loss
2023-07-04 16:05:01 +08:00
..
__init__.py [model checkpoint] updated saving/loading for 1d layers (#594) 2022-04-01 16:51:52 +08:00
_operation.py [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-07-04 16:05:01 +08:00
_utils.py [Tensor] 1d row embedding (#1075) 2022-06-08 12:04:59 +08:00
layers.py [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-07-04 16:05:01 +08:00