license, model-index
| license |
model-index |
| apache-2.0 |
| name |
results |
| Tess-10.7B-v1.5 |
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| AI2 Reasoning Challenge (25-Shot) |
ai2_arc |
ARC-Challenge |
test |
|
|
| type |
value |
name |
| acc_norm |
65.02 |
normalized accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
split |
args |
| HellaSwag (10-Shot) |
hellaswag |
validation |
|
|
| type |
value |
name |
| acc_norm |
84.07 |
normalized accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| MMLU (5-Shot) |
cais/mmlu |
all |
test |
|
|
| type |
value |
name |
| acc |
65.09 |
accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| TruthfulQA (0-shot) |
truthful_qa |
multiple_choice |
validation |
|
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| Winogrande (5-shot) |
winogrande |
winogrande_xl |
validation |
|
|
| type |
value |
name |
| acc |
83.35 |
accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| GSM8k (5-shot) |
gsm8k |
main |
test |
|
|
| type |
value |
name |
| acc |
54.36 |
accuracy |
|
|
|
|
|
|
|
Please use the updated version Tess-10.7B-v1.5b
Tess-10.7B-v1.5b has hyperparameter optimizations. Access at: https://huggingface.co/migtissera/Tess-10.7B-v1.5b

Tess, short for Tesoro (Treasure in Italian), is a general purpose Large Language Model series. Tess-10.7B-v1.5 was trained on the SOLAR-10.7B base.
Prompt Format:
Detailed results can be found here
| Metric |
Value |
| Avg. |
66.55 |
| AI2 Reasoning Challenge (25-Shot) |
65.02 |
| HellaSwag (10-Shot) |
84.07 |
| MMLU (5-Shot) |
65.09 |
| TruthfulQA (0-shot) |
47.43 |
| Winogrande (5-shot) |
83.35 |
| GSM8k (5-shot) |
54.36 |