ColossalAI/colossalai/nn/layer/parallel_1d
FoolPlayer 8cc11235c0 [shardformer]: Feature/shardformer, add some docstring and readme (#3816)
* init shardformer code structure

* add implement of sharder (inject and replace)

* add implement of replace layer to colossal layer

* separate different layer policy, add some notion

* implement 1d and 2d slicer, can tell col or row

* fix bug when slicing and inject model

* fix some bug; add inference test example

* add share weight and train example

* add train

* add docstring and readme

* add docstring for other files

* pre-commit
2023-07-04 16:05:01 +08:00
..
__init__.py [model checkpoint] updated saving/loading for 1d layers (#594) 2022-04-01 16:51:52 +08:00
_operation.py [shardformer]: Feature/shardformer, add some docstring and readme (#3816) 2023-07-04 16:05:01 +08:00
_utils.py [Tensor] 1d row embedding (#1075) 2022-06-08 12:04:59 +08:00
layers.py [shardformer]: Feature/shardformer, add some docstring and readme (#3816) 2023-07-04 16:05:01 +08:00