ColossalAI/tests/test_autochunk/test_autochunk_transformer
Xuanlei Zhao 30dd13c450
[autochunk] support complete benchmark (#3121)
* refact memory code

* dont log free var memory

* add memory align

* update chunk target

* update setting for new memory

* finish test

* update tracer

* update typo

* update test

* add unet test

* add bench

* update bench

* update bench

* init

* support vit

* move to cpu

* add cpu benchmark
2023-03-13 17:42:37 +08:00
..
benchmark_autochunk_transformer.py [autochunk] support complete benchmark (#3121) 2023-03-13 17:42:37 +08:00
test_autochunk_gpt.py [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00
test_autochunk_transformer_utils.py [autochunk] refactor chunk memory estimation (#2762) 2023-03-08 16:22:30 +08:00