ZIBEE/bi_150-vllm
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
13969be800f3a333a3a1b87776b217ae16b48230
bi_150-vllm/vllm/v1/worker/gpu
History
LZiBee 938d0854a5 Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
..
metrics
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
mm
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
model_states
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
pool
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
sample
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
spec_decode
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
__init__.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
async_utils.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
attn_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
block_table.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
buffer_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
cp_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
cudagraph_utils.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
dp_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
input_batch.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
kv_connector.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
lora_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
model_runner.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00
pp_utils.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
README.md
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
states.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
structured_outputs.py
Add minimal vLLM 0.16.1 build repo for BI-V150
2026-04-18 10:56:22 +08:00
warmup.py
Upgrade to vllm 0.17.0 corex v4.1 overlay
2026-04-29 19:38:22 +08:00

README.md

[Experimental] Model Runner V2

This directory contains the new model runner which is under active development. Ping Woosuk Kwon for any changes.