ColossalAI/colossalai
YuliangLiu0306 fee2af8610
[autoparallel] adapt autoparallel with new analyzer (#3261)
* [autoparallel] adapt autoparallel with new analyzer

* fix all node handler tests

* polish

* polish
2023-03-30 17:47:24 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
_analyzer [autoparallel] adapt autoparallel with new analyzer (#3261) 2023-03-30 17:47:24 +08:00
amp [NFC] polish colossalai/amp/__init__.py code style (#3272) 2023-03-29 15:22:21 +08:00
auto_parallel [autoparallel] adapt autoparallel with new analyzer (#3261) 2023-03-30 17:47:24 +08:00
autochunk [autochunk] support vit (#3084) 2023-03-10 10:23:26 +08:00
booster [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2022-09-08 22:11:04 +08:00
checkpoint_io [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
cli [NFC] polish colossalai/cli/benchmark/models.py code style (#3290) 2023-03-29 15:22:21 +08:00
cluster [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
communication [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
context [NFC] polish colossalai/context/random/__init__.py code style (#3327) 2023-03-30 14:19:26 +08:00
device [hotfix] add copyright for solver and device mesh (#2803) 2023-02-18 21:14:38 +08:00
engine [NFC] polish colossalai/engine/gradient_handler/__init__.py code style (#3329) 2023-03-30 14:19:39 +08:00
fx [autoparallel] adapt autoparallel with new analyzer (#3261) 2023-03-30 17:47:24 +08:00
gemini [NFC] polish colossalai/gemini/paramhooks/_param_hookmgr.py code style 2023-03-29 15:47:42 +08:00
interface [booster] implemented the torch ddd + resnet example (#3232) 2023-03-27 10:24:14 +08:00
kernel updated flash attention usage 2023-03-20 17:57:04 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn [NFC] polish colossalai/nn/_ops/addmm.py code style (#3274) 2023-03-29 15:22:21 +08:00
pipeline [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
registry Remove duplication registry (#1078) 2022-06-08 07:47:24 +08:00
tensor Add interface for colo tesnor dp size (#3227) 2023-03-27 09:42:21 +08:00
testing [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [lazyinit] combine lazy tensor with dtensor (#3204) 2023-03-23 10:53:06 +08:00
zero [zero] Refactor ZeroContextConfig class using dataclass (#3186) 2023-03-21 12:36:47 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py [Tensor] distributed view supports inter-process hybrid parallel (#1169) 2022-06-27 09:45:26 +08:00
global_variables.py [NFC] polish colossalai/global_variables.py code style (#3259) 2023-03-29 15:22:21 +08:00
initialize.py Fix False warning in initialize.py (#2456) 2023-01-12 13:49:01 +08:00