EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Correcting default configuration when benchmarking fused_moe (#4665)

Browse Source
This commit is contained in:
penguin_wwy
2025-03-22 15:52:34 +08:00
committed by GitHub
parent 8cd4250401
commit 38f25e87fc
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
benchmark/kernels/fused_moe_triton/tuning_fused_moe_triton.py
View File

@@ -267,6 +267,7 @@ class BenchmarkWorker:
topk, topk,
dtype_str, dtype_str,
False, False,
block_shape,
) )
else: else:
config = op_config[min(op_config.keys(), key=lambda x: abs(x - num_tokens))] config = op_config[min(op_config.keys(), key=lambda x: abs(x - num_tokens))]