ColossalAI/colossalai/nn/layer
digger-yu b9a8dff7e5
[doc] Fix typo under colossalai and doc(#3618)
* Fixed several spelling errors under colossalai

* Fix the spelling error in colossalai and docs directory

* Cautious Changed the spelling error under the example folder

* Update runtime_preparation_pass.py

revert autograft to autograd

* Update search_chunk.py

utile to until

* Update check_installation.py

change misteach to mismatch in line 91

* Update 1D_tensor_parallel.md

revert to perceptron

* Update 2D_tensor_parallel.md

revert to perceptron in line 73

* Update 2p5D_tensor_parallel.md

revert to perceptron in line 71

* Update 3D_tensor_parallel.md

revert to perceptron in line 80

* Update README.md

revert to resnet in line 42

* Update reorder_graph.py

revert to indice in line 7

* Update p2p.py

revert to megatron in line 94

* Update initialize.py

revert to torchrun in line 198

* Update routers.py

change to detailed in line 63

* Update routers.py

change to detailed in line 146

* Update README.md

revert  random number in line 402
2023-04-26 11:38:43 +08:00
..
colossalai_layer fixed using zero with tp cannot access weight correctly 2023-02-28 10:52:30 +08:00
moe [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
parallel_1d [doc] Fix typo under colossalai and doc(#3618) 2023-04-26 11:38:43 +08:00
parallel_2d [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2022-09-06 20:18:35 +08:00
parallel_2p5d [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2022-09-06 20:18:35 +08:00
parallel_3d improved allgather & reducescatter for 3d 2023-01-03 17:46:08 +08:00
parallel_sequence [NFC] polish colossalai/nn/layer/parallel_sequence/layers.py code style (#1280) 2022-07-13 12:08:21 +08:00
utils
vanilla added skip_bias_add for non-tp linear 2022-11-09 15:41:08 +08:00
wrapper [NFC] polish colossalai/nn/layer/wrapper/pipeline_wrapper.py code style (#1303) 2022-07-13 19:01:07 +08:00
__init__.py
base_layer.py [utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) 2022-09-06 20:18:35 +08:00