### What this PR does / why we need it? Suffix Decoding is a CPU-based speculative decoding optimization that accelerates inference by pattern matching and frequency-based prediction from both prompts and generated content. This document provides a step-by-step guide for deploying and evaluating **Suffix Speculative Decoding** on the **Ascend** platform. By analyzing performance gains across diverse datasets, it demonstrates the significant advantages of this technology in inference acceleration. Our goal is to empower developers to achieve high-efficiency model optimization using Ascend hardware. ### Does this PR introduce _any_ user-facing change? NO ### How was this patch tested? - vLLM version: v0.14.1 - vLLM main: https://github.com/vllm-project/vllm/commit/dc917cceb877dfd13f98c538c4c96158047d98bd --------- Signed-off-by: zhangmuzhibangde <1037640609@qq.com>
vLLM Ascend Plugin documents
Live doc: https://docs.vllm.ai/projects/ascend
Build the docs
# Install dependencies.
pip install -r requirements-docs.txt
# Build the docs.
make clean
make html
# Build the docs with translation
make intl
# Open the docs with your browser
python -m http.server -d _build/html/
Launch your browser and open:
- English version: http://localhost:8000
- Chinese version: http://localhost:8000/zh_CN