Files
codeparrot-small-multi/eval_results.txt

3 lines
293 B
Plaintext
Raw Permalink Normal View History

temperature 0.2: {'pass@1': 0.027439024390243896, 'pass@10': 0.041979293327556816, 'pass@100': 0.04268292682926801}
temperature 0.8: {'pass@1': 0.013262195121951224, 'pass@10': 0.04670902438514701, 'pass@100': 0.0899080946922357}
best: {'pass@1': 2.74% , 'pass@10': 4.67 , 'pass@100': 8.99%}