zouyida2052 ec98320285 correct bug to fix the value of max_num_tokens (#3933) ...

### What this PR does / why we need it?
correct bug to fix the value of max_num_tokens

- vLLM version: v0.11.0
- vLLM main:
83f478bb19

Signed-off-by: zouyida2052 <zouyida2002@gmail.com>

2025-11-03 14:17:51 +08:00

..

attention

[Feat][UT] Support Deepseekv32 FULL_DECODE_ONLY mode and add unit test of sfa_v1 (#3763)

2025-11-03 10:02:47 +08:00

compilation

[Perf] Move attention update stream out of loop to optimize performance (#3848)

2025-11-03 09:19:57 +08:00

core

Upgrade to new vllm commit (#3719)

2025-10-25 15:36:32 +08:00

device_allocator

[Misc]Clean up useless import from vllm (#2049)

2025-07-28 16:01:59 +08:00

distributed

[bugfix]cancel tokenize for layerwise_proxy (#3914)

2025-10-30 23:54:46 +08:00

eplb

[CI]Fix oom of deepseek-eplb nigtly test. (#3884)

2025-10-30 10:18:07 +08:00

kv_offload

Upgrade to 0.11.1 newest vllm commit (#3762)

2025-10-28 14:55:03 +08:00

lora

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

model_loader

Upgrade to new vllm commit (#3719)

2025-10-25 15:36:32 +08:00

models

[Model][3/N] Refactor sfa into mla and remove deepseek_v3_2.py (#3769)

2025-10-30 17:06:38 +08:00

ops

Update torch-npu version to 2.7.1 (#3896)

2025-10-31 17:16:31 +08:00

patch

[Model][3/N] Refactor sfa into mla and remove deepseek_v3_2.py (#3769)

2025-10-30 17:06:38 +08:00

quantization

【Bugfix】bugfix for weight load of kimi-k2 (#3798)

2025-10-27 21:18:35 +08:00

sample

Upgrade to 0.11.1 newest vllm commit (#3762)

2025-10-28 14:55:03 +08:00

spec_decode

[feature] support pcp + mtp (with pd disaggregate) (#3822)

2025-10-31 15:43:22 +08:00

torchair

correct bug to fix the value of max_num_tokens (#3933)

2025-11-03 14:17:51 +08:00

worker

[Feat][UT] Support Deepseekv32 FULL_DECODE_ONLY mode and add unit test of sfa_v1 (#3763)

2025-11-03 10:02:47 +08:00

__init__.py

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

ascend_config.py

[1/N][Refactor] Refactor code to adapt with vllm main (#3612)

2025-10-24 16:55:08 +08:00

ascend_forward_context.py

Update torch-npu version to 2.7.1 (#3896)

2025-10-31 17:16:31 +08:00

cpu_binding.py

[main] support cpu binding (#3546)

2025-10-21 09:17:03 +08:00

envs.py

[main] remove dbo code (#3712)

2025-10-25 15:53:01 +08:00

meta_registration.py

Fix the bugs about operator registration by PyTorch Dispatcher (#2786)

2025-09-13 11:58:52 +08:00

platform.py

mfix bug when max_seqs=14 in mtp=2 scenario and raise error when cudagraph_capture_sizes can't be an integer multiple of uniform_decode_query_lentp (#3910)

2025-10-31 09:24:50 +08:00

utils.py

Update torch-npu version to 2.7.1 (#3896)

2025-10-31 17:16:31 +08:00