ColossalAI/colossalai/nn/layer
Jiarui Fang a445e118cf
[polish] polish singleton and global context (#500)
2022-03-23 18:03:39 +08:00
..
colossalai_layer moved env variables to global variables; (#215) 2022-02-15 11:31:13 +08:00
moe [polish] polish singleton and global context (#500) 2022-03-23 18:03:39 +08:00
parallel_1d fix format (#376) 2022-03-11 15:50:28 +08:00
parallel_2d fixed padding index issue for vocab parallel embedding layers; updated 3D linear to be compatible with examples in the tutorial 2022-03-11 15:50:28 +08:00
parallel_2p5d fix format parallel_2p5d (#357) 2022-03-11 15:50:28 +08:00
parallel_3d fix format for dir-[parallel_3d] (#333) 2022-03-11 15:50:28 +08:00
parallel_sequence adapted for sequence parallel (#163) 2022-01-20 13:44:51 +08:00
utils Added activation offload (#331) 2022-03-11 15:50:28 +08:00
vanilla flake8 style (#352) 2022-03-11 15:50:28 +08:00
wrapper flake8 style (#352) 2022-03-11 15:50:28 +08:00
__init__.py [MOE] changed parallelmode to dist process group (#460) 2022-03-19 13:46:29 +08:00
base_layer.py Migrated project 2021-10-28 18:21:23 +02:00