ColossalAI/tests/test_infer
flybird11111 2ddf624a86
[shardformer] upgrade transformers to 4.39.3 (#5815)
* [shardformer]upgrade transformers for gpt2/gptj/whisper (#5807)

* [shardformer] fix modeling of gpt2 and gptj

* [shardformer] fix whisper modeling

* [misc] update requirements

---------

Co-authored-by: ver217 <lhx0217@gmail.com>

* [shardformer]upgrade transformers for mistral (#5808)

* upgrade transformers for mistral

* fix

* fix

* [shardformer]upgrade transformers for llama (#5809)

* update transformers

fix

* fix

* fix

* [inference] upgrade transformers (#5810)

* update transformers

fix

* fix

* fix

* fix

* fix

* [gemini] update transformers for gemini (#5814)

---------

Co-authored-by: ver217 <lhx0217@gmail.com>
2024-06-14 10:59:33 +08:00
..
test_async_engine
test_kernels [shardformer] upgrade transformers to 4.39.3 (#5815) 2024-06-14 10:59:33 +08:00
test_models [Inference] Fix flash-attn import and add model test (#5794) 2024-06-12 14:13:50 +08:00
__init__.py
_utils.py
test_batch_bucket.py
test_config_and_struct.py
test_continuous_batching.py
test_cuda_graph.py
test_drafter.py
test_inference_engine.py
test_kvcache_manager.py
test_request_handler.py
test_rpc_engine.py
test_streamingllm.py [Inference]Add Streaming LLM (#5745) 2024-06-05 10:51:19 +08:00