Correcting default configuration when benchmarking fused_moe (#4665)
This commit is contained in:
@@ -267,6 +267,7 @@ class BenchmarkWorker:
|
||||
topk,
|
||||
dtype_str,
|
||||
False,
|
||||
block_shape,
|
||||
)
|
||||
else:
|
||||
config = op_config[min(op_config.keys(), key=lambda x: abs(x - num_tokens))]
|
||||
|
||||
Reference in New Issue
Block a user