flybird11111 2ddf624a86 [shardformer] upgrade transformers to 4.39.3 (#5815) ... * [shardformer]upgrade transformers for gpt2/gptj/whisper (#5807) * [shardformer] fix modeling of gpt2 and gptj * [shardformer] fix whisper modeling * [misc] update requirements --------- Co-authored-by: ver217 <lhx0217@gmail.com> * [shardformer]upgrade transformers for mistral (#5808) * upgrade transformers for mistral * fix * fix * [shardformer]upgrade transformers for llama (#5809) * update transformers fix * fix * fix * [inference] upgrade transformers (#5810) * update transformers fix * fix * fix * fix * fix * [gemini] update transformers for gemini (#5814) --------- Co-authored-by: ver217 <lhx0217@gmail.com>		2024-06-14 10:59:33 +08:00
..
test_async_engine	[Inference] Fix bugs and docs for feat/online-server (#5598)	2024-05-08 15:20:53 +00:00
test_kernels	[shardformer] upgrade transformers to 4.39.3 (#5815)	2024-06-14 10:59:33 +08:00
test_models	[Inference] Fix flash-attn import and add model test (#5794)	2024-06-12 14:13:50 +08:00
__init__.py	[Fix] Fix Inference Example, Tests, and Requirements (#5688)	2024-05-08 11:30:15 +08:00
_utils.py	[Inference] Add the logic of the inference engine (#5173)	2024-01-11 13:39:56 +00:00
test_batch_bucket.py	[Fix/Inference] Fix format of input prompts and input model in inference engine (#5395)	2024-02-23 10:51:35 +08:00
test_config_and_struct.py	[Fix] Fix Inference Example, Tests, and Requirements (#5688)	2024-05-08 11:30:15 +08:00
test_continuous_batching.py	[inference] Fix running time of test_continuous_batching (#5750)	2024-05-24 19:34:15 +08:00
test_cuda_graph.py	[Fix] Fix Inference Example, Tests, and Requirements (#5688)	2024-05-08 11:30:15 +08:00
test_drafter.py	[Fix] Fix Inference Example, Tests, and Requirements (#5688)	2024-05-08 11:30:15 +08:00
test_inference_engine.py	[Inference] Fix bugs and docs for feat/online-server (#5598)	2024-05-08 15:20:53 +00:00
test_kvcache_manager.py	[Fix] Fix & Update Inference Tests (compatibility w/ main)	2024-05-05 16:28:56 +00:00
test_request_handler.py	[Fix] Fix & Update Inference Tests (compatibility w/ main)	2024-05-05 16:28:56 +00:00
test_rpc_engine.py	[release] update version (#5752)	2024-05-31 19:40:26 +08:00
test_streamingllm.py	[Inference]Add Streaming LLM (#5745)	2024-06-05 10:51:19 +08:00