Add evaluation results on SWE-Bench Verified (#42)
- Add evaluation results on SWE-Bench Verified (7584eabf4ba1460402b4b7e95103d51acf724d2f) - Rename .eval_results/swe_bench_verified.yaml A to .eval_results/swe_bench_verified.yaml (f8ed508a03f6c8aadef1d53e02b553aab0446773) - Update .eval_results/swe_bench_verified.yaml (a2e5c2dbbd5128e04af0d7523d29f799b4b3f19f) - Update .eval_results/swe_bench_verified.yaml (6543d1bffd005fe14f52d269a39281c524bd63ea) Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co> (batch 1/1)
This commit is contained in:
9
.eval_results/swe_bench_verified.yaml
Normal file
9
.eval_results/swe_bench_verified.yaml
Normal file
@@ -0,0 +1,9 @@
|
||||
- dataset:
|
||||
id: SWE-bench/SWE-bench_Verified
|
||||
task_id: swe_bench_%_resolved
|
||||
value: 75.80
|
||||
source:
|
||||
url: https://www.swebench.com/
|
||||
name: SWE-Bench official evaluation
|
||||
user: nielsr
|
||||
notes: high reasoning
|
||||
Reference in New Issue
Block a user