realliujiaxu 6bc770cd78 [Perf] fix async copy for async scheduling (#4113) ...

### What this PR does / why we need it?
Only CPU tensors with `pin_memory=True` can be asynchronously copied to
the device. Currently, there are two instances where non-pinned CPU
tensors are being copied to the device, which will trigger synchronous
operations, reducing the expected benefits of asynchronous scheduling.

- vLLM version: v0.11.0
- vLLM main:
83f478bb19

Signed-off-by: realliujiaxu <realliujiaxu@163.com>

2025-11-13 09:11:26 +08:00

..

__init__.py

[Misc][V0 Deprecation] Remove Cache Engine Used for V0 Worker (#1878)

2025-07-19 09:42:32 +08:00

block_table.py

[Perf] fix async copy for async scheduling (#4113)

2025-11-13 09:11:26 +08:00

model_runner_v1.py

[Perf] fix async copy for async scheduling (#4113)

2025-11-13 09:11:26 +08:00

npu_input_batch.py

[feature] chunkprefill support pcp&dcp (#3801)

2025-11-11 09:18:02 +08:00

worker_v1.py

Upgrade to 0.11.1 newest vllm commit (#3982)

2025-11-12 23:01:19 +08:00