Update developer doc for v0.11.0-dev. This PR mainly picks developer doc from main to v0.11.0-dev. All related Feature work with 0.11.0 already. Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
17 lines
373 B
Markdown
17 lines
373 B
Markdown
# Feature Guide
|
|
|
|
This section provides an overview of the features implemented in vLLM Ascend. Developers can refer to this guide to understand how vLLM Ascend works.
|
|
|
|
:::{toctree}
|
|
:caption: Feature Guide
|
|
:maxdepth: 1
|
|
patch
|
|
ModelRunner_prepare_inputs
|
|
disaggregated_prefill
|
|
eplb_swift_balancer.md
|
|
Multi_Token_Prediction
|
|
ACL_Graph
|
|
KV_Cache_Pool_Guide
|
|
add_custom_aclnn_op
|
|
:::
|