EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Support for Phi-1.5 & Phi-2 models (#7862)

Browse Source
This commit is contained in:
Praneth Paruchuri
2025-07-14 07:13:40 +05:30
committed by GitHub
parent e2ed9d049a
commit cb736df854
4 changed files with 324 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
test/srt/models/test_generation_models.py
View File

@@ -65,6 +65,7 @@ ALL_MODELS = [
"THUDM/glm-4-9b-chat", tp_size=2, trust_remote_code=True, skip_long_prompt=True
),
ModelCase("openai-community/gpt2"),
ModelCase("microsoft/phi-1_5", trust_remote_code=True),
ModelCase("microsoft/Phi-3-small-8k-instruct", trust_remote_code=True),
ModelCase("allenai/OLMo-2-1124-7B-Instruct", skip_long_prompt=True),
ModelCase("ibm-granite/granite-3.0-2b-instruct", skip_long_prompt=True),