Wang Kunpeng
e3a2443c3a
[main][Doc] add mla pertoken quantization FAQ ( #2018 )
...
### What this PR does / why we need it?
When using deepseek series models generated by the --dynamic parameter,
if torchair graph mode is enabled, we should modify the configuration
file in the CANN package to prevent incorrect inference results.
- vLLM version: v0.10.0
- vLLM main:
https://github.com/vllm-project/vllm/commit/7728dd77bb802e1876012eb264df4d2fa2fc6f3c
---------
Signed-off-by: Wang Kunpeng <1289706727@qq.com >
2025-07-27 08:47:51 +08:00
Li Wang
bdfb065b5d
[1/2/N] Enable pymarkdown and python __init__ for lint system ( #2011 )
...
### What this PR does / why we need it?
1. Enable pymarkdown check
2. Enable python `__init__.py` check for vllm and vllm-ascend
3. Make clean code
### How was this patch tested?
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/29c6fbe58cfa705c26ed1b38f262d5ade0b4f9ba
---------
Signed-off-by: wangli <wangli858794774@gmail.com >
2025-07-25 22:16:10 +08:00
wangxiyuan
eb921d2b6f
[Doc] Fix 404 error ( #1797 )
...
Fix url 404 error in doc
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/9ad0a4588ba4e9c979cda0d178dec4fcdb89fd0c
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-07-15 11:52:38 +08:00
wangxiyuan
b5b7e0ecc7
[Doc] Add qwen3 embedding 8b guide ( #1734 )
...
1. Add the tutorials for qwen3-embedding-8b
2. Remove VLLM_USE_V1=1 in docs, it's useless any more from 0.9.2
- vLLM version: v0.9.2
- vLLM main:
https://github.com/vllm-project/vllm/commit/5923ab9524e32006ffb9354c5340b6988a45fe3e
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-07-11 17:40:17 +08:00
wangxiyuan
3d1e6a5929
[Doc] Update user doc index ( #1581 )
...
Add user doc index to make the user guide more clear
- vLLM version: v0.9.1
- vLLM main:
https://github.com/vllm-project/vllm/commit/49e8c7ea256bd48a36391b5bc72212af39278b67
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com >
2025-07-10 14:26:59 +08:00