Update MTP doc (#4290)

This commit is contained in:
Ke Bao
2025-03-11 15:46:55 +08:00
committed by GitHub
parent dce303e279
commit 3a08f54638
2 changed files with 21 additions and 5 deletions

View File

@@ -8,7 +8,7 @@
"\n",
"SGLang now provides an EAGLE2-based speculative decoding option. Our implementation aims to maximize speed and efficiency and is considered to be among the fastest in open-source LLM engines.\n",
"\n",
"**Note:** Currently, Speculative Decoding in SGLang does not support radix cache.\n",
"**Note:** Currently, Speculative Decoding in SGLang is compatible with radix cache and chunked prefill.\n",
"\n",
"### Performance Highlights\n",
"\n",