EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
8fda31cafeb5f41c16e87c66d1cbbd7b7ae3245b
xc-llm-ascend/docs/source/user_guide/suppoted_features.md
Shanshan Shen 8fda31cafe [Doc] Update Feature Support doc (#234) 
### What this PR does / why we need it?
Update Feature Support doc.

### Does this PR introduce _any_ user-facing change?
no.

### How was this patch tested?
no.

---------

Signed-off-by: Shanshan Shen <467638484@qq.com>
2025-03-04 14:18:32 +08:00

880 B
Raw Blame History

Feature Support

Feature Supported Note
Chunked Prefill ✗ Plan in 2025 Q1
Automatic Prefix Caching ✅ Improve performance in 2025 Q2
LoRA ✗ Plan in 2025 Q1
Prompt adapter ✗ Plan in 2025 Q1
Speculative decoding ✗ Plan in 2025 Q1
Pooling ✗ Plan in 2025 Q2
Enc-dec ✗ Plan in 2025 Q2
Multi Modality ✅ (LLaVA/Qwen2-vl/Qwen2-audio/internVL) Add more model support in 2025 Q1
LogProbs ✅
Prompt logProbs ✅
Async output ✅
Multi step scheduler ✗ Plan in 2025 Q1
Best of ✅
Beam search ✅
Guided Decoding ✅ Find more details at the issue
Tensor Parallel ✅ Only "mp" supported now
Pipeline Parallel ✅ Only "mp" supported now