EngineX/xc-llm-ascend
3
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
ac1ba1d8d2aa77971da3333257f44af3755ac6c7
xc-llm-ascend/docs/source/user_guide/suppoted_features.md
wangxiyuan c25631ec7b [Doc] Add the release note for 0.7.3rc1 (#285) 
Add the release note for 0.7.3rc1

Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
2025-03-13 17:57:06 +08:00

2.5 KiB
Raw Blame History

Feature Support

Feature Supported CI Coverage Guidance Document Current Status Next Step
Chunked Prefill ❌ NA Plan in 2025.03.30
Automatic Prefix Caching ❌ NA Plan in 2025.03.30
LoRA ❌ NA Plan in 2025.06.30
Prompt adapter ❌ NA Plan in 2025.06.30
Speculative decoding ✅ Basic functions available Need fully test
Pooling ✅ Basic functions available(Bert) Need fully test and add more models support
Enc-dec ❌ NA Plan in 2025.06.30
Multi Modality ✅ ✅ Basic functions available(LLaVA/Qwen2-vl/Qwen2-audio/internVL) Improve perforamance, and add more models support
LogProbs ✅ Basic functions available Need fully test
Prompt logProbs ✅ Basic functions available Need fully test
Async output ✅ Basic functions available Need fully test
Multi step scheduler ✅ Basic functions available Need fully test
Best of ✅ Basic functions available Need fully test
Beam search ✅ Basic functions available Need fully test
Guided Decoding ✅ Basic functions available Find more details at the issue
Tensor Parallel ✅ Basic functions available Need fully test
Pipeline Parallel ✅ Basic functions available Need fully test