github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai
History
FoolPlayer 21a3915c98 [shardformer] add Dropout layer support different dropout pattern (#3856) 
* add dropout layer, add dropout test

* modify seed manager as context manager

* add a copy of col_nn.layer

* add dist_crossentropy loss; separate module test

* polish the code

* fix dist crossentropy loss
 		2023-06-08 15:01:34 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
_analyzer [example] add train resnet/vit with booster example (#3694) 2023-05-08 10:42:30 +08:00
amp [bf16] add bf16 support (#3882) 2023-06-05 15:58:31 +08:00
auto_parallel [nfc] fix typo colossalai/ applications/ (#3831) 2023-05-25 16:19:41 +08:00
autochunk fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808) 2023-05-24 09:01:50 +08:00
booster [doc] fix docs about booster api usage (#3898) 2023-06-06 13:36:11 +08:00
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2022-09-08 22:11:04 +08:00
checkpoint_io [booster] torch fsdp fix ckpt (#3788) 2023-05-23 16:58:45 +08:00
cli Modify torch version requirement to adapt torch 2.0 (#3896) 2023-06-05 15:57:35 +08:00
cluster fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808) 2023-05-24 09:01:50 +08:00
communication [CI] fix some spelling errors (#3707) 2023-05-10 17:12:03 +08:00
context [CI] fix some spelling errors (#3707) 2023-05-10 17:12:03 +08:00
device [dtensor] updated api and doc (#3845) 2023-06-08 10:18:17 +08:00
engine fix typo colossalai/auto_parallel autochunk fx/passes etc. (#3808) 2023-05-24 09:01:50 +08:00
fx [nfc] fix typo colossalai/cli fx kernel (#3847) 2023-06-02 15:02:45 +08:00
interface [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
kernel [bf16] add bf16 support (#3882) 2023-06-05 15:58:31 +08:00
lazy [dtensor] updated api and doc (#3845) 2023-06-08 10:18:17 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-06-08 15:01:34 +08:00
pipeline [nfc]fix typo colossalai/pipeline tensor nn (#3899) 2023-06-06 14:07:36 +08:00
registry Remove duplication registry (#1078) 2022-06-08 07:47:24 +08:00
shardformer [shardformer] add Dropout layer support different dropout pattern (#3856) 2023-06-08 15:01:34 +08:00
tensor [dtensor] updated api and doc (#3845) 2023-06-08 10:18:17 +08:00
testing [NFC] fix typo with colossalai/auto_parallel/tensor_shard (#3742) 2023-05-17 11:13:23 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [lazy] refactor lazy init (#3891) 2023-06-05 14:20:47 +08:00
zero [bf16] add bf16 support (#3882) 2023-06-05 15:58:31 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py [Tensor] distributed view supports inter-process hybrid parallel (#1169) 2022-06-27 09:45:26 +08:00
global_variables.py [NFC] polish colossalai/global_variables.py code style (#3259) 2023-03-29 15:22:21 +08:00
initialize.py [zero] reorganize zero/gemini folder structure (#3424) 2023-04-04 13:48:16 +08:00