Yizhou 1f25d60870 [Fix] Cap max tokens to prevent potential OOM (#3720) ...

### What this PR does / why we need it?
Caps the calculated maximum number of tokens at 512.

This prevents allocating an excessively large buffer when a cudagraph
capture size is not specified, mitigating the risk of out-of-memory
errors.

### Does this PR introduce _any_ user-facing change?
None.

### How was this patch tested?
None.

- vLLM version: v0.11.0rc3
- vLLM main:
17c540a993

Signed-off-by: Yizhou Liu <liu_yizhou@outlook.com>

2025-10-25 11:23:21 +08:00

..

attention

[Refactor] Refactor Ascend attention implementation forward (#3714)

2025-10-25 08:58:35 +08:00

compilation

[Feat]Make full graph mode compalible with MTP (#3276)

2025-10-17 20:19:56 +08:00

core

[BugFix][Core] Fix a bug running multi-modal with ascend_scheduler (#3675)

2025-10-25 09:41:33 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

look up multi_tp key (#3699)

2025-10-24 17:23:36 +08:00

eplb

[CI]Add EPLB CI. (#3568)

2025-10-21 22:58:02 +08:00

kv_offload

[Feat] add native kvcache offload (#3433)

2025-10-22 14:15:49 +08:00

lora

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

model_loader

[Misc] Add a model loader that utilizes HCCL for weight loading (#2888)

2025-10-23 15:56:07 +08:00

models

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

multistream

[Quickfix] update CachedRequestState as NewRequestData changed (#2367)

2025-08-15 07:35:27 +08:00

ops

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

patch

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

quantization

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

sample

Drop 0.10.2 (#3284)

2025-10-09 10:28:38 +08:00

spec_decode

[Refactor] optimize _prepare_inputs method in eagle_proposer (#3296)

2025-10-25 09:49:42 +08:00

torchair

[Refactor] Refactor Ascend attention implementation forward (#3714)

2025-10-25 08:58:35 +08:00

worker

[Fix] Cap max tokens to prevent potential OOM (#3720)

2025-10-25 11:23:21 +08:00

__init__.py

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

ascend_config.py

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

ascend_forward_context.py

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

support cp&dcp (#3260)

2025-10-24 10:32:01 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

[Refactor] Refactor Ascend attention implementation forward (#3714)

2025-10-25 08:58:35 +08:00

utils.py

[Refactor] [MoE] Rename moe-related classes & files (#3646)

2025-10-25 11:22:03 +08:00