wangxiaoteng888 and liziyu
b1a00e0512
[docs] [P/D] add feature guide for disaggregated-prefill ( #3950 )
...
### What this PR does / why we need it?
add feature guide for disaggregated-prefill
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
by ci
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
---------
Signed-off-by: wangxiaoteng <wangxiaoteng@huawei.com >
Signed-off-by: liziyu <liziyu16@huawei.com >
Signed-off-by: wangxiaoteng888 <56506195+wangxiaoteng888@users.noreply.github.com >
Co-authored-by: liziyu <liziyu16@huawei.com >
2025-11-10 09:31:30 +08:00
offline893 and offline0806
5cff3069f4
[Doc]Add developer guide of eplb. ( #3759 )
...
### What this PR does / why we need it?
Add developer guide of eplb
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
---------
Signed-off-by: offline0806 <3337230449@qq.com >
Co-authored-by: offline0806 <3337230449@qq.com >
2025-11-05 18:35:41 +08:00
pz1116
e0c23cb011
[docs] Add kv pool developer guide ( #3752 )
...
### What this PR does / why we need it?
Add kv pool developer guide
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
vLLM version: v0.11.0rc3
vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
---------
Signed-off-by: Pz1116 <zpbzpb123123@gmail.com >
Signed-off-by: pz1116 <zpbzpb123123@gmail.com >
2025-11-05 18:03:36 +08:00
zouyida2052
1ba158567c
[Doc] add mtp doc ( #3770 )
...
### What this PR does / why we need it?
add mtp develop doc
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
---------
Signed-off-by: zouyida2052 <zouyida2002@gmail.com >
2025-11-05 16:38:35 +08:00
zzzzwwjj
46d5a77688
[docs] add aclgraph developer guide ( #3683 )
...
### What this PR does / why we need it?
Add aclgraph developer guide.
- vLLM version: v0.11.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/83f478bb19489b41e9d208b47b4bb5a95ac171ac
Signed-off-by: zzzzwwjj <1183291235@qq.com >
2025-11-05 10:34:28 +08:00
zhangxinyuehfad
789ba4c5c2
[Doc] Update doc ( #3836 )
...
### What this PR does / why we need it?
Update doc
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
- vLLM version: v0.11.0rc3
- vLLM main:
https://github.com/vllm-project/vllm/commit/releases/v0.11.1
Signed-off-by: hfadzxy <starmoon_zhang@163.com >
2025-10-29 11:03:39 +08:00
wangxiyuan
13e8e75143
[Refactor] refactor patch module ( #3555 )
...
### What this PR does / why we need it?
we notice that `patch_main` is never used. Usually the patch is for all
version. And if it's for specified version, we can use `vllm_version_is`
instead. So let's remove the useless sub folder in patch module to make
it clear.
- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-10-21 20:19:46 +08:00
TaoYu Chen
5fe883fa43
fix the title of modelrunner's prepare inputs docs ( #3457 )
...
### What this PR does / why we need it?
Fix the wrong title of the modelrunner_prepare_inputs docs
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
pass CI
- vLLM version: v0.11.0rc3
- vLLM main: https://github.com/vllm-project/vllm/commit/v0.11.0
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com >
2025-10-14 20:35:58 +08:00
TaoYu Chen
9e7c168d99
Add ModelRunner_prepare_inputs doc ( #1493 )
...
### What this PR does / why we need it?
To help more developers quickly get started with vLLM, we need to write
clear and easy-to-understand code documentation and technical
interpretations. This will effectively lower the learning curve, attract
more excellent contributors, and collectively build a better developer
community.
Add ModelRunner_prepare_inputs doc
### Does this PR introduce _any_ user-facing change?
no
### How was this patch tested?
Pass CI
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/4be02a37767f05a3fd27d66435d5cebea7a9bfe8
---------
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com >
2025-08-18 15:41:24 +08:00
Yikun Jiang
17a430f7b8
Upgrade vLLM to v0.10.0 ( #1927 )
...
### What this PR does / why we need it?
- Upgrade to v0.10.0
- Drop v0.9.2 version compatibility
- Add patch for
`vllm_ascend/patch/worker/patch_common/patch_sampler_gather_logprobs.py`
as workaround of
https://github.com/vllm-project/vllm/commit/f3a683b7c9df8b251092e48e53d58220bb920f2c
for v0.10.0 and also add e2e test `test_models_prompt_logprobs`
- Pin transformers<4.54.0 as workaround of
https://github.com/vllm-project/vllm-ascend/issues/2034
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
- Test locally:
`VLLM_USE_MODELSCOPE=true pytest -sv
tests/e2e/singlecard/test_offline_inference.py::test_models_prompt_logprobs`
- CI passed
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/7728dd77bb802e1876012eb264df4d2fa2fc6f3c
---------
Signed-off-by: Yikun Jiang <yikunkero@gmail.com >
2025-07-26 15:43:29 +08:00
Li Wang
bdfb065b5d
[1/2/N] Enable pymarkdown and python __init__ for lint system ( #2011 )
...
### What this PR does / why we need it?
1. Enable pymarkdown check
2. Enable python `__init__.py` check for vllm and vllm-ascend
3. Make clean code
### How was this patch tested?
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/29c6fbe58cfa705c26ed1b38f262d5ade0b4f9ba
---------
Signed-off-by: wangli <wangli858794774@gmail.com >
2025-07-25 22:16:10 +08:00
wangxiyuan
830332ebfc
Clean up v0.9.1 code ( #1672 )
...
vllm has released 0.9.2. This PR drop 0.9.1 support.
- vLLM version: v0.9.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/b942c094e3ab905aeb16f4136353f378e17159e8
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-07-09 08:52:24 +08:00
Zesheng Zong
192dbbcc6e
Optimize Patch developer guide ( #1452 )
...
### What this PR does / why we need it?
Fix some terms in the user guide.
Signed-off-by: zeshengzong <zesheng.zong@outlook.com >
2025-06-26 19:10:16 +08:00
wangxiyuan
205cb85a1e
[Doc] Fix doc typo ( #1424 )
...
1. Fix the typo
2. Fix 404 url
3. update graph mode and additional config user guide
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-06-25 19:28:26 +08:00
wangxiyuan
e4e0b7af05
[Doc] Add patch doc ( #1414 )
...
1. Format the developer guide content to make it more clear
2. Add the patch doc for developer guide
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-06-25 12:00:45 +08:00