EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

[CI]Add guided decoding test (#422)

Browse Source 
### What this PR does / why we need it?
After extensive testing, we are happy to say that guided_decoding is
fully supported by npu, in this pr, we add guided_decoding integrated
with our test, mainly does the following things:
1. test v0 supported backends including ` "outlines",
"lm-format-enforcer","xgrammar"`
2. test v1 supported backends including ` "guidance", "xgrammar"`

---------

Signed-off-by: wangli <wangli858794774@gmail.com>
This commit is contained in:
Li Wang
2025-04-22 17:50:06 +08:00
committed by GitHub
parent 538a69c145
commit cf6ab42ee2
2 changed files with 176 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
requirements-dev.txt
View File

@@ -4,3 +4,4 @@ pytest >= 6.0
pytest-asyncio
lm-eval
ray
types-jsonschema