github
/
ColossalAI
mirror of https://github.com/hpcaitech/ColossalAI
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
ColossalAI/colossalai
History
eric8607242 9880fd2cd8
Fix state_dict key missing issue of the ZeroDDP (#2363) 
* Fix state_dict output for ZeroDDP duplicated parameters

* Rewrite state_dict based on get_static_torch_model

* Modify get_static_torch_model to be compatible with the lower version (ZeroDDP)
 		2023-01-09 14:35:14 +08:00
..
_C [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
amp [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
auto_parallel Revert "[NFC] polish code format" (#2372) 2023-01-06 16:01:09 +08:00
builder [NFC] polish colossalai/builder/__init__.py code style (#1560) 2022-09-08 22:11:04 +08:00
cli [cli] updated installation check cli for aot/jit build (#2395) 2023-01-09 11:05:27 +08:00
communication [NFC] polish communication/p2p_v2.py code style (#2303) 2023-01-04 15:09:57 +08:00
context [hotfix] Fixing the bug related to ipv6 support 2022-12-27 12:42:46 +08:00
device [device] find best logical mesh 2023-01-05 17:21:29 +08:00
engine [engin/schedule] use p2p_v2 to recontruct pipeline_schedule (#1408) 2022-08-12 11:33:26 +08:00
fx [auto-parallel] refactoring ColoTracer (#2118) 2023-01-04 14:44:22 +08:00
gemini [Gemini] fix the convert_to_torch_module bug (#2269) 2023-01-03 15:55:35 +08:00
kernel [hotfix] issue #2388 2023-01-07 18:23:02 +08:00
logging [logger] hotfix, missing _FORMAT (#2231) 2022-12-29 22:59:39 +08:00
nn Fix state_dict key missing issue of the ZeroDDP (#2363) 2023-01-09 14:35:14 +08:00
pipeline fix diff device in some partition 2023-01-06 15:59:06 +08:00
registry Remove duplication registry (#1078) 2022-06-08 07:47:24 +08:00
tensor [hotfix] fix implement error in diffusers 2023-01-07 07:56:39 +08:00
testing [amp] add gradient clipping for unit tests (#2283) 2023-01-04 11:59:56 +08:00
trainer [polish] remove useless file _mem_tracer_hook.py (#1963) 2022-11-16 15:55:10 +08:00
utils [setup] support pre-build and jit-build of cuda kernels (#2374) 2023-01-06 20:50:26 +08:00
zero [zero] polish low level zero optimizer (#2275) 2023-01-03 17:22:34 +08:00
__init__.py [setup] supported conda-installed torch (#2048) 2022-11-30 16:45:15 +08:00
constants.py updated tp layers 2022-11-02 12:19:38 +08:00
core.py [Tensor] distributed view supports inter-process hybrid parallel (#1169) 2022-06-27 09:45:26 +08:00
global_variables.py updated tp layers 2022-11-02 12:19:38 +08:00
initialize.py [hotfix] remove potiential circle import (#1307) 2022-07-14 13:44:26 +08:00