ColossalAI/colossalai
YH 7b13f7db18
[zero] trivial zero optimizer refactoring (#2869)
* Fix mionr grad store interface

* Apply lint
2023-02-27 14:04:53 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
amp [test] fixed the triton version for testing (#2608) 2023-02-07 13:49:38 +08:00
auto_parallel [hotfix] fix autoparallel compatibility test issues (#2754) 2023-02-23 17:28:36 +08:00
autochunk [autochunk] support diffusion for autochunk (#2621) 2023-02-07 16:32:45 +08:00
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2022-09-08 22:11:04 +08:00
cli [cli] handled version check exceptions (#2848) 2023-02-21 17:04:49 +08:00
communication [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
context [NFC] polish colossalai/context/process_group_initializer/initializer_2d.py code style (#2726) 2023-02-15 22:27:13 +08:00
device [hotfix] add copyright for solver and device mesh (#2803) 2023-02-18 21:14:38 +08:00
engine [NFC] polish colossalai/engine/schedule/_pipeline_schedule.py code style (#2744) 2023-02-20 10:38:40 +08:00
fx [autoparallel] Patch meta information of `torch.matmul` (#2584) 2023-02-08 11:05:31 +08:00
gemini [hotfix] fix chunk size can not be divided (#2867) 2023-02-22 15:04:46 +08:00
kernel [triton] added copyright information for flash attention (#2835) 2023-02-21 11:25:57 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn [hotfix]: Remove math.prod dependency (#2837) 2023-02-23 23:56:15 +08:00
pipeline polish pp middleware (#2476) 2023-01-13 16:56:01 +08:00
registry Remove duplication registry (#1078) 2022-06-08 07:47:24 +08:00
tensor [hotfix]: Remove math.prod dependency (#2837) 2023-02-23 23:56:15 +08:00
testing [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils Don't use `torch._six` (#2775) 2023-02-17 09:22:45 +08:00
zero [zero] trivial zero optimizer refactoring (#2869) 2023-02-27 14:04:53 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py [Tensor] distributed view supports inter-process hybrid parallel (#1169) 2022-06-27 09:45:26 +08:00
global_variables.py updated tp layers 2022-11-02 12:19:38 +08:00
initialize.py Fix False warning in initialize.py (#2456) 2023-01-12 13:49:01 +08:00