EngineX-Ascend/enginex-ascend-910-vllm
11
0
Fork 1
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
ebfeac9863f46f249bf15f136530e9cad3898b61
enginex-ascend-910-vllm/docs/source/user_guide/feature_guide/index.md
Sun Ruoxi 7f8a1b1f7a init v0.23.0 
Signed-off-by: Sun Ruoxi <sunruoxi@4paradigm.com>
2026-08-27 15:11:51 +08:00

625 B
Raw Blame History

Feature Guide

This section provides a detailed usage guide of vLLM Ascend features.

:::{toctree} :caption: Feature Guide :maxdepth: 1 graph_mode cpu_binding Ai_QoS_introduction_en quantization sleep_mode structured_output lora expert_parallelism_load_balancer netloader rfork dynamic_batch epd_disaggregation kv_pool layerwise_kv_pool kv_cache_cpu_offload recompute_cpu_offload external_dp large_scale_ep ucm_deployment Fine_grained_TP layer_sharding speculative_decoding context_parallel weight_prefetch sequence_parallelism batch_invariance lmcache_ascend_deployment dynamic_chunk_pipeline_parallel flash_attention :::