pz1116 a7f91fce71 [KV Pool]get_num_new_matched_tokens return 0 if token length < block_size (#7146) ...

### What this PR does / why we need it?
Currently, we call lookup_client for looking up token hit in KV Pool,
however, when token length < block size, the key will be empty and there
is no point to lookup in KV Pool backend since there will never be a
hit.
Hence, add early return in `get_num_new_matched_tokens` when `token_len`
< `block_size`

### Does this PR introduce _any_ user-facing change?

### How was this patch tested?

- vLLM version: v0.16.0
- vLLM main:
4034c3d32e

---------

Signed-off-by: Pz1116 <zpbzpb123123@gmail.com>
Co-authored-by: fems14 <1804143737@qq.com>

2026-03-11 15:05:34 +08:00

..

device_communicators

[CI]Fixed the spell check function in typos.toml (#6753)

2026-02-14 11:57:26 +08:00

kv_transfer

[KV Pool]get_num_new_matched_tokens return 0 if token length < block_size (#7146)

2026-03-11 15:05:34 +08:00

__init__.py

[Refactor]Refactor of vllm_ascend/distributed module (#5719)

2026-01-15 08:57:40 +08:00

parallel_state.py

[P/D]Mooncake Layerwise Connector supports hybrid attention manager with multiple kvcache groups (#7022)

2026-03-10 23:59:20 +08:00

utils.py

[Lint]Style: Convert vllm-ascend/ to ruff format(Batch #10) (#6173)

2026-02-06 15:35:06 +08:00