yuehuayingxueluo 4f28cb43c0 [inference]Optimize the usage of the mid tensors space in flash attn (#5304) ... * opt flash attn * opt tmp tensor * fix benchmark_llama * fix code style * fix None logic for output tensor * fix adapted to get_xine_cache * add comment * fix ci bugs * fix some codes * rm duplicated codes * rm duplicated codes * fix code style * add _get_dtype in config.py		2024-01-26 14:00:10 +08:00
..
benchmark_llama.py	[inference]Optimize the usage of the mid tensors space in flash attn (#5304)	2024-01-26 14:00:10 +08:00
build_smoothquant_weight.py	[inference] refactor examples and fix schedule (#5077)	2023-11-21 10:46:03 +08:00
run_benchmark.sh	[inference]Optimize the usage of the mid tensors space in flash attn (#5304)	2024-01-26 14:00:10 +08:00
run_llama_inference.py	[inference] refactor examples and fix schedule (#5077)	2023-11-21 10:46:03 +08:00