wangxiyuan b979ee353d [Misc] Code clean up (#1679) ...

Make model_runner_v1 more readable

- vLLM version: v0.9.2
- vLLM main:
baed180aa0

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>

2025-07-09 14:33:40 +08:00

..

attention

[Misc] Add attention mask (#1673)

2025-07-09 09:12:03 +08:00

compilation

[CI] Upgrade vllm to 0.9.1 (#1165)

2025-06-11 16:33:11 +08:00

core

Clean up v0.9.1 code (#1672)

2025-07-09 08:52:24 +08:00

device_allocator

[Build] Add build info (#1386)

2025-06-27 09:14:43 +08:00

distributed

[bugfix] some bugs maybe fail to run (#896)

2025-06-03 11:07:33 +08:00

lora

[Bugfix] fix import error (#600)

2025-04-22 08:57:25 +08:00

models

Clean up v0.9.1 code (#1672)

2025-07-09 08:52:24 +08:00

multistream

[perf]: support dual-batch overlap(dbo) for deepseek (#941)

2025-06-07 16:46:58 +08:00

ops

Clean up v0.9.1 code (#1672)

2025-07-09 08:52:24 +08:00

patch

Clean up v0.9.1 code (#1672)

2025-07-09 08:52:24 +08:00

pool

[Bugfix] Add func swap_states to fix MLA attention (#1580)

2025-07-02 17:42:53 +08:00

quantization

perf: use multicast to avoid padding decode request to prefill size (#1555)

2025-07-07 22:36:03 +08:00

sample

Spec decode support for V1 Engine (#874)

2025-05-23 14:25:46 +08:00

worker

[Misc] Code clean up (#1679)

2025-07-09 14:33:40 +08:00

__init__.py

[CI] Patch torch.library.infer_schema for fused moe ops to fix CI (#854)

2025-05-14 19:49:09 +08:00

ascend_config.py

[CI] Follow vLLM FusedMoEParallelConfig interface change and clean up unused config (#1625)

2025-07-04 17:54:33 +08:00

envs.py

Clean up v0.9.1 code (#1672)

2025-07-09 08:52:24 +08:00

platform.py

[CORE]initial support for torchair with non-mla backend (#1506)

2025-07-03 22:21:42 +08:00

utils.py

feat: add kv cache memory cache and skip dynamo guard (#1549)

2025-07-07 22:37:14 +08:00