[BugFix] Fix top_p,top_k issue with EAGLE and add top_p,top_k in EAGLE e2e (#5131)
### What this PR does / why we need it?
Add top_p,top_k in EAGLE e2e
- vLLM version: v0.12.0
- vLLM main:
ad32e3e19c
Signed-off-by: zhaomingyu <zhaomingyu13@h-partners.com>
This commit is contained in:
@@ -145,7 +145,9 @@ def test_eagle_correctness(
|
||||
|
||||
sampling_params = SamplingParams(
|
||||
max_tokens=300,
|
||||
temperature=0.0,
|
||||
temperature=0.8,
|
||||
top_p=0.7,
|
||||
top_k=4,
|
||||
ignore_eos=False,
|
||||
)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user