EngineX-Mthreads/enginex-mthreads-vllm
4
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
5aef6c175a8d269aca60083adaa5a565eb911c72
enginex-mthreads-vllm/vllm/v1/worker/gpu
History
xiezhongtao 5aef6c175a Sync from v0.13
2026-01-19 10:38:50 +08:00
..
metrics
Sync from v0.13
2026-01-19 10:38:50 +08:00
sample
Sync from v0.13
2026-01-19 10:38:50 +08:00
spec_decode
Sync from v0.13
2026-01-19 10:38:50 +08:00
__init__.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
async_utils.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
attn_utils.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
block_table.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
cudagraph_utils.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
dp_utils.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
input_batch.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
model_runner.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
README.md
Sync from v0.13
2026-01-19 10:38:50 +08:00
states.py
Sync from v0.13
2026-01-19 10:38:50 +08:00
structured_outputs.py
Sync from v0.13
2026-01-19 10:38:50 +08:00

README.md

[Experimental] Model Runner V2

This directory contains the new model runner which is under active development. Ping Woosuk Kwon for any changes.