Files

11 lines
217 B
JSON
Raw Permalink Normal View History

{
"human-eval": {
"pass@1": {
"num_entries": 164,
"avg_tokens": 427,
"gen_seconds": 34,
"passing_base_tests": 28.658536585365855,
"passing_plus_tests": 26.21951219512195
}
}
}