EngineX/xc-llm-kunlun
3
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

[Model] registry llama.py to vLLM

Browse Source
This commit is contained in:
Xinyu Dong
2025-12-15 21:21:28 +08:00
committed by GitHub
parent ca059110b3
commit 7c7d0326c5
1 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
vllm_kunlun/models/__init__.py
View File

@@ -78,6 +78,10 @@ def register_model():
"SeedOssForCausalLM", "SeedOssForCausalLM",
"vllm_kunlun.models.seed_oss:SeedOssForCausalLM") "vllm_kunlun.models.seed_oss:SeedOssForCausalLM")
ModelRegistry.register_model(
"LlamaForCausalLM",
"vllm_kunlun.models.llama:LlamaForCausalLM")
def register_quant_method(): def register_quant_method():
"""to do""" """to do"""