language, license, datasets, inference, model-index
| language |
license |
datasets |
inference |
model-index |
|
|
apache-2.0 |
| argilla/OpenHermes2.5-dpo-binarized-alpha |
| Locutusque/Hercules-v3.0 |
|
| parameters |
| do_sample |
temperature |
top_p |
top_k |
min_new_tokens |
max_new_tokens |
repetition_penalty |
| true |
0.8 |
0.95 |
40 |
2 |
250 |
1.1 |
|
|
| name |
results |
| NeuralReyna-Mini-1.8B-v0.3 |
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| AI2 Reasoning Challenge (25-Shot) |
ai2_arc |
ARC-Challenge |
test |
|
|
| type |
value |
name |
| acc_norm |
35.58 |
normalized accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
split |
args |
| HellaSwag (10-Shot) |
hellaswag |
validation |
|
|
| type |
value |
name |
| acc_norm |
61.13 |
normalized accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| MMLU (5-Shot) |
cais/mmlu |
all |
test |
|
|
| type |
value |
name |
| acc |
44.22 |
accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| TruthfulQA (0-shot) |
truthful_qa |
multiple_choice |
validation |
|
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| Winogrande (5-shot) |
winogrande |
winogrande_xl |
validation |
|
|
| type |
value |
name |
| acc |
60.93 |
accuracy |
|
|
|
|
| task |
dataset |
metrics |
source |
| type |
name |
| text-generation |
Text Generation |
|
| name |
type |
config |
split |
args |
| GSM8k (5-shot) |
gsm8k |
main |
test |
|
|
| type |
value |
name |
| acc |
6.75 |
accuracy |
|
|
|
|
|
|
|
NeuralReyna-Mini-1.8B-v0.3

Description
Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the argilla/OpenHermes2.5-dpo-binarized-alpha.
This model has capabilities in coding, math, science, roleplay, and function calling.
This model was trained on OpenAI's ChatML prompt format.
Quants
HQQ - https://huggingface.co/twoxfh/NeuralReyna-Mini-hqq-1.8B-v0.3
Evaluation
Coming soon
Contributions
Thanks to @aloobun and @Locutusque for their contributions to this model.
Detailed results can be found here
| Metric |
Value |
| Avg. |
41.77 |
| AI2 Reasoning Challenge (25-Shot) |
35.58 |
| HellaSwag (10-Shot) |
61.13 |
| MMLU (5-Shot) |
44.22 |
| TruthfulQA (0-shot) |
41.99 |
| Winogrande (5-shot) |
60.93 |
| GSM8k (5-shot) |
6.75 |