ColossalAI/tests/test_autochunk/test_autochunk_transformer
Xuanlei Zhao 2ca9728cbb
[autochunk] refactor chunk memory estimation (#2762)
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test
2023-03-08 16:22:30 +08:00
..
benchmark_autochunk_transformer.py [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00
test_autochunk_gpt.py [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00
test_autochunk_transformer_utils.py [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00