ColossalAI/colossalai
Frank Lee 39163417a1
[example] updated the hybrid parallel tutorial (#2444)
* [example] updated the hybrid parallel tutorial

* polish code
2023-01-11 15:17:17 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
amp [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
auto_parallel [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00
autochunk adapt new fx 2023-01-10 11:56:00 +08:00
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2022-09-08 22:11:04 +08:00
cli [example] updated the hybrid parallel tutorial (#2444) 2023-01-11 15:17:17 +08:00
communication [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
context Update parallel_context.py (#2408) 2023-01-10 11:27:23 +08:00
device [autoparallel] integrate device mesh initialization into autoparallelize (#2393) 2023-01-11 14:03:49 +08:00
engine [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2022-08-12 11:33:26 +08:00
fx [fx] allow native ckpt trace and codegen. (#2438) 2023-01-11 13:49:59 +08:00
gemini [ddp] add is_ddp_ignored (#2434) 2023-01-11 12:22:45 +08:00
kernel [hotfix] issue #2388 2023-01-07 18:23:02 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn [zero] fix state_dict and load_state_dict for ddp ignored parameters (#2443) 2023-01-11 14:55:41 +08:00
pipeline fix diff device in some partition 2023-01-06 15:59:06 +08:00
registry
tensor [hotfix] fix implement error in diffusers 2023-01-07 07:56:39 +08:00
testing [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [ddp] add is_ddp_ignored (#2434) 2023-01-11 12:22:45 +08:00
zero [ddp] add is_ddp_ignored (#2434) 2023-01-11 12:22:45 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py
global_variables.py updated tp layers 2022-11-02 12:19:38 +08:00
initialize.py