ColossalAI/tests/test_autochunk/test_alphafold
oahzxl 05671fcb42
[autochunk] support multi outputs chunk search (#2538)
Support multi outputs chunk search. Previously we only support single output chunk search. It is more flexible and improve performance by a large margin. For transformer, we reduce memory by 40% than previous search strategy.

1. rewrite search strategy to support multi outputs chunk search
2. fix many, many bugs
3. update tests
2023-02-01 13:18:51 +08:00
..
test_alphafold_utils.py [autochunk] support multi outputs chunk search (#2538) 2023-02-01 13:18:51 +08:00
test_evoformer_block.py [autochunk] support multi outputs chunk search (#2538) 2023-02-01 13:18:51 +08:00
test_evoformer_stack.py [autochunk] support multi outputs chunk search (#2538) 2023-02-01 13:18:51 +08:00
test_extramsa_block.py [autochunk] support multi outputs chunk search (#2538) 2023-02-01 13:18:51 +08:00