You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

digger-yu b9a8dff7e5 [doc] Fix typo under colossalai and doc(#3618) ... * Fixed several spelling errors under colossalai * Fix the spelling error in colossalai and docs directory * Cautious Changed the spelling error under the example folder * Update runtime_preparation_pass.py revert autograft to autograd * Update search_chunk.py utile to until * Update check_installation.py change misteach to mismatch in line 91 * Update 1D_tensor_parallel.md revert to perceptron * Update 2D_tensor_parallel.md revert to perceptron in line 73 * Update 2p5D_tensor_parallel.md revert to perceptron in line 71 * Update 3D_tensor_parallel.md revert to perceptron in line 80 * Update README.md revert to resnet in line 42 * Update reorder_graph.py revert to indice in line 7 * Update p2p.py revert to megatron in line 94 * Update initialize.py revert to torchrun in line 198 * Update routers.py change to detailed in line 63 * Update routers.py change to detailed in line 146 * Update README.md revert random number in line 402		2 years ago
..
colossalai_layer	fixed using zero with tp cannot access weight correctly	2 years ago
moe	[doc] Fix typo under colossalai and doc(#3618)	2 years ago
parallel_1d	[doc] Fix typo under colossalai and doc(#3618)	2 years ago
parallel_2d	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2 years ago
parallel_2p5d	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2 years ago
parallel_3d	improved allgather & reducescatter for 3d	2 years ago
parallel_sequence	…
utils	…
vanilla	added skip_bias_add for non-tp linear	2 years ago
wrapper	…
__init__.py	…
base_layer.py	[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548)	2 years ago