Files

11 lines
215 B
JSON
Raw Permalink Normal View History

{
"human-eval": {
"pass@1": {
"num_entries": 164,
"avg_tokens": 98,
"gen_seconds": 20,
"passing_base_tests": 44.51219512195122,
"passing_plus_tests": 38.41463414634146
}
}
}