b446763c2d56f53d438886d674f09de61d090ecc
Without this: vllm server crashes immediately on startup with argparse error: 'unrecognized arguments: --reasoning-parser qwen3' because computility-run.yaml passes this flag but vllm 0.6.3 does not recognize it. The container stays running but HTTP server never becomes ready, causing benchmark-agent to poll indefinitely (status=running). This is likely why task_id=3905102 benchmark has been running for 36+ minutes without result — the vllm process died but the container lives on. Changes: cli_args.py: Add --reasoning-parser as accepted argument (str, default=None) The value is parsed by argparse but not used by api_server.py or serving_chat.py — it is a stub that prevents the crash. Actual reasoning token separation (<think>...</think>) for Qwen3 models would require implementing a ReasoningParser class similar to ToolParser. For now, reasoning tokens will appear in the response content, which is acceptable for functional tests (content is correct, just includes thinking tokens). CCCL context: dispatch_batch_memcpy.cuh's two-level dispatch pattern: small buffers → single CTA (fast path, no coordination overhead) large buffers → multi CTA (slow path, needs scan+select) Analogously: known CLI args → fast parse, unknown → crash. Adding the stub is the 'fast path' that avoids the crash.
project_6
Description
Languages
C++
41.8%
Cuda
31.6%
Python
22.2%
C
2.1%
CMake
1.1%
Other
1.1%