Commit Graph

4 Commits (8c69debdc7128e1b8839f12aa3f19ad327569017)

Author SHA1 Message Date
yuehuayingxueluo 6fb4bcbb24
[Inference/opt] Fused KVCahce Memcopy (#5374)
10 months ago
Frank Lee 8106ede07f
Revert "[Inference] Adapt to Fused rotary (#5348)" (#5373)
10 months ago
Jianghai 9f4ab2eb92
[Inference] Adapt to Fused rotary (#5348)
10 months ago
Frank Lee e76acbb076
[inference] moved ops tests to test_infer (#5354)
10 months ago