Xuanlei Zhao
10c61de2f7
[autochunk] support vit ( #3084 )
...
support vit for autochunk
* support some new ops for vit
* fix some bugs
* add test for vit
2 years ago
Xuanlei Zhao
2ca9728cbb
[autochunk] refactor chunk memory estimation ( #2762 )
...
* refact memory code
* dont log free var memory
* add memory align
* update chunk target
* update setting for new memory
* finish test
* update tracer
* update typo
* update test
2 years ago
oahzxl
6ba8364881
[autochunk] support diffusion for autochunk ( #2621 )
...
* add alphafold benchmark
* renae alphafold test
* rename tests
* rename diffuser
* renme
* rename
* update transformer
* update benchmark
* update benchmark
* update bench memory
* update transformer benchmark
* rename
* support diffuser
* support unet metainfo prop
* fix bug and simplify code
* update linear and support some op
* optimize max region search, support conv
* update unet test
* support some op
* support groupnorm and interpolate
* update flow search
* add fix dim in node flow
* fix utils
* rename
* support diffusion
* update diffuser
* update chunk search
* optimize imports
* import
* finish autochunk
2 years ago
oahzxl
05671fcb42
[autochunk] support multi outputs chunk search ( #2538 )
...
Support multi outputs chunk search. Previously we only support single output chunk search. It is more flexible and improve performance by a large margin. For transformer, we reduce memory by 40% than previous search strategy.
1. rewrite search strategy to support multi outputs chunk search
2. fix many, many bugs
3. update tests
2 years ago
oahzxl
63199c6687
[autochunk] support transformer ( #2526 )
2 years ago
oahzxl
c04f183237
[autochunk] support parsing blocks ( #2506 )
2 years ago
oahzxl
72341e65f4
[auto-chunk] support extramsa ( #3 ) ( #2504 )
2 years ago
oahzxl
ecccc91f21
[autochunk] support autochunk on evoformer ( #2497 )
2 years ago
oahzxl
4953b4ace1
[autochunk] support evoformer tracer ( #2485 )
...
support full evoformer tracer, which is a main module of alphafold. previously we just support a simplifed version of it.
1. support some evoformer's op in fx
2. support evoformer test
3. add repos for test code
2 years ago
oahzxl
7ab2db206f
adapt new fx
2 years ago
oahzxl
fd818cf144
change imports
2 years ago
oahzxl
a591d45b29
add available
2 years ago
oahzxl
615e7e68d9
update doc
2 years ago
oahzxl
7d4abaa525
add doc
2 years ago
oahzxl
1be0ac3cbf
add doc for trace indice
2 years ago
oahzxl
0b6af554df
remove useless function
2 years ago
oahzxl
d914a21d64
rename
2 years ago
oahzxl
865f2e0196
rename
2 years ago
oahzxl
a4ed5b0d0d
rename in doc
2 years ago
oahzxl
1bb1f2ad89
rename
2 years ago
oahzxl
cb9817f75d
rename function from index to indice
2 years ago
oahzxl
0ea903b94e
rename trace_index to trace_indice
2 years ago
oahzxl
065f0b4c27
add doc for search
2 years ago
oahzxl
a68d240ed5
add doc for search chunk
2 years ago
oahzxl
1951f7fa87
code style
2 years ago
oahzxl
212b5b1b5f
add comments
2 years ago
oahzxl
19cc64b1d3
remove autochunk_available
2 years ago
oahzxl
4d223e18a2
fix typo
2 years ago
oahzxl
8a989a0d89
code style
2 years ago
oahzxl
c3a2bf48b4
code style
2 years ago
oahzxl
a6cdbf9161
seperate trace flow
2 years ago
oahzxl
4748967fb1
ad reorder graph
2 years ago
oahzxl
da4076846d
rename
2 years ago
oahzxl
c3d72f7db9
seperate reorder
2 years ago
oahzxl
6685a9d022
seperate non chunk input
2 years ago
oahzxl
f856611d21
seperate prepose_nodes
2 years ago
oahzxl
f4a1607e56
seperate input node dim search
2 years ago
oahzxl
ae27a8b26d
seperate flow tracer
2 years ago
oahzxl
fd87d78a28
rename ambiguous variable
2 years ago
oahzxl
2bde9d2b7f
code format
2 years ago
oahzxl
8a634af2f5
close mem and code print
2 years ago
oahzxl
1a6d2a740b
take apart chunk code gen
2 years ago
oahzxl
efb1c64c30
restruct dir
2 years ago