Shanshan Shen 65c1f4579f [V1][Structured Output] Add apply_grammar_bitmask() method to model runner (#555) ...

### What this PR does / why we need it?
Add `apply_grammar_bitmask()` method to model runner.

This method is necessary for `xgrammar` structured output.

---------

Signed-off-by: shen-shanshan <467638484@qq.com>

2025-04-18 16:47:55 +08:00

..

__init__.py

[Core] Support pooling (#229)

2025-03-04 15:59:34 +08:00

draft_model_runner.py

[SpecDecode] Add spec decode support (#500)

2025-04-17 20:16:32 +08:00

model_runner_v1.py

[V1][Structured Output] Add apply_grammar_bitmask() method to model runner (#555)

2025-04-18 16:47:55 +08:00

model_runner.py

[Misc] Fix import error and address nits to make CI happy (#563)

2025-04-18 12:23:32 +08:00

multi_step_runner.py

[MISC] fix logger (#515)

2025-04-15 10:18:05 +08:00

multi_step_worker.py

support multistep decode (#299)

2025-03-11 19:20:06 +08:00

pooling_model_runner.py

[CI]Add model basic accuracy test(Qwen2.5-0.5B-Instruct) (#460)

2025-04-17 14:59:56 +08:00

worker_v1.py

Add sleep mode feature for Ascend NPU (#513)

2025-04-18 13:11:39 +08:00

worker.py

Add sleep mode feature for Ascend NPU (#513)

2025-04-18 13:11:39 +08:00