ColossalAI/colossalai
oahzxl 6ba8364881
[autochunk] support diffusion for autochunk (#2621)
* add alphafold benchmark

* renae alphafold test

* rename tests

* rename diffuser

* renme

* rename

* update transformer

* update benchmark

* update benchmark

* update bench memory

* update transformer benchmark

* rename

* support diffuser

* support unet metainfo prop

* fix bug and simplify code

* update linear and support some op

* optimize max region search, support conv

* update unet test

* support some op

* support groupnorm and interpolate

* update flow search

* add fix dim in node flow

* fix utils

* rename

* support diffusion

* update diffuser

* update chunk search

* optimize imports

* import

* finish autochunk
2023-02-07 16:32:45 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
amp [test] fixed the triton version for testing (#2608) 2023-02-07 13:49:38 +08:00
auto_parallel [autoparallel] accelerate gpt2 training (#2495) 2023-01-29 11:13:15 +08:00
autochunk [autochunk] support diffusion for autochunk (#2621) 2023-02-07 16:32:45 +08:00
builder
cli [cli] fixed hostname mismatch error (#2465) 2023-01-12 14:52:09 +08:00
communication [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
context Revert "Update parallel_context.py (#2408)" 2023-01-19 12:27:48 +08:00
device [autoparallel] accelerate gpt2 training (#2495) 2023-01-29 11:13:15 +08:00
engine
fx support unet metainfo prop (#2544) 2023-02-02 16:19:26 +08:00
gemini [hotfix] fix zero ddp warmup check (#2545) 2023-02-02 16:42:38 +08:00
kernel [kernel] fixed repeated loading of kernels (#2549) 2023-02-03 09:47:13 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn [hotfix] fix zero ddp warmup check (#2545) 2023-02-02 16:42:38 +08:00
pipeline polish pp middleware (#2476) 2023-01-13 16:56:01 +08:00
registry
tensor [polish] polish ColoTensor and its submodules (#2537) 2023-02-03 11:44:10 +08:00
testing [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [polish] polish ColoTensor and its submodules (#2537) 2023-02-03 11:44:10 +08:00
zero [zero] add zero wrappers (#2523) 2023-01-29 17:52:58 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py
global_variables.py updated tp layers 2022-11-02 12:19:38 +08:00
initialize.py Fix False warning in initialize.py (#2456) 2023-01-12 13:49:01 +08:00