Zheng Wengang 2d120f8b18 [Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292) ...

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

2025-08-06 23:21:40 -07:00

..

lora

Support GPU pinning for LoRA (#8697)

2025-08-06 19:39:45 -07:00

compare.py

[Feature] Initial support for multi-LoRA serving (#1307)

2024-09-12 16:46:14 -07:00

test_clip_models.py

support clip embedding model (#4506)

2025-03-27 00:18:15 -07:00

test_compressed_tensors_models.py

restruct compressed_tensors_w8a8_fp8 (#5475)

2025-04-19 04:52:15 -07:00

test_cross_encoder_models.py

Feat/support rerank (#6058)

2025-06-16 10:50:01 -07:00

test_dummy_grok_models.py

Add V2-lite model test (#7390)

2025-07-03 22:25:50 -07:00

test_embedding_models.py

support qwen3 emebedding (#6990)

2025-06-09 01:32:49 -07:00

test_encoder_embedding_models.py

Enable FlashInfer support encoder models and add head_dim padding workaround (#6230)

2025-07-19 19:30:16 -07:00

test_generation_models.py

Support bailing moe (#8680)

2025-08-05 20:40:34 -07:00

test_gme_qwen_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_grok_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_llama4_models.py

Update CI tests for Llama4 models (#6421)

2025-06-01 11:52:15 +08:00

test_mtp_models.py

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

test_qwen_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_reward_models.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_transformers_models.py

Clean up server args (#8161)

2025-07-19 11:32:52 -07:00

test_unsloth_models.py

[Model Support] unsloth/Phi-4-mini bnb model (#4982)

2025-04-16 19:58:20 -07:00

test_vlm_models.py

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292)

2025-08-06 23:21:40 -07:00