Xiaoyu Zhang 34b364e073 optimize cuda graph max_bs_settings on low-end gpus (#2360)

2024-12-06 01:13:04 -08:00

..

sglang

optimize cuda graph max_bs_settings on low-end gpus (#2360)

2024-12-06 01:13:04 -08:00

pyproject.toml

minor: limit the range of vllm versions (#2350)

2024-12-05 02:00:34 +08:00

upload_pypi.sh

Fix test cases (#6)

2024-01-15 01:15:53 -08:00