ColossalAI/colossalai
Xuanlei Zhao 2ca9728cbb
[autochunk] refactor chunk memory estimation (#2762)
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test
2023-03-08 16:22:30 +08:00
..
_C
amp
auto_parallel
autochunk [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00
builder
cli
communication
context
device
engine [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
fx [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
gemini [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
kernel [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
logging
nn [format] applied code formatting on changed files in pull request 2997 (#3008) 2023-03-06 10:42:22 +08:00
pipeline [pipeline] Add Simplified Alpa DP Partition (#2507) 2023-03-07 10:34:31 +08:00
registry
tensor [DTensor] refactor CommSpec (#3034) 2023-03-08 10:45:31 +08:00
testing
trainer
utils [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
zero [doc] add deepspeed citation and copyright (#2996) 2023-03-04 20:08:11 +08:00
__init__.py
constants.py
core.py
global_variables.py
initialize.py