NeuralReyna-Mini-1.8B-v0.3-GGUF/README.md

base_model, datasets, inference, language, license, model-index, model_creator, model_name, pipeline_tag, quantized_by, tags

base_model	datasets	inference	language	license	model-index	model_creator	model_name	pipeline_tag	quantized_by	tags
M4-ai/NeuralReyna-Mini-1.8B-v0.3	argilla/OpenHermes2.5-dpo-binarized-alpha Locutusque/Hercules-v3.0	false	en	apache-2.0	name results NeuralReyna-Mini-1.8B-v0.3 dataset metrics source task args config name split type num_few_shot 25 ARC-Challenge AI2 Reasoning Challenge (25-Shot) test ai2_arc name type value normalized accuracy acc_norm 35.58 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation dataset metrics source task args name split type num_few_shot 10 HellaSwag (10-Shot) validation hellaswag name type value normalized accuracy acc_norm 61.13 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation dataset metrics source task args config name split type num_few_shot 5 all MMLU (5-Shot) test cais/mmlu name type value accuracy acc 44.22 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation dataset metrics source task args config name split type num_few_shot 0 multiple_choice TruthfulQA (0-shot) validation truthful_qa type value mc2 41.99 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation dataset metrics source task args config name split type num_few_shot 5 winogrande_xl Winogrande (5-shot) validation winogrande name type value accuracy acc 60.93 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation dataset metrics source task args config name split type num_few_shot 5 main GSM8k (5-shot) test gsm8k name type value accuracy acc 6.75 name url Open LLM Leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=M4-ai/NeuralReyna-Mini-1.8B-v0.3 name type Text Generation text-generation	M4-ai	NeuralReyna-Mini-1.8B-v0.3	text-generation	afrideva	gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0

M4-ai/NeuralReyna-Mini-1.8B-v0.3-GGUF

Quantized GGUF model files for NeuralReyna-Mini-1.8B-v0.3 from M4-ai

Name	Quant method	Size
neuralreyna-mini-1.8b-v0.3.fp16.gguf	fp16	3.68 GB
neuralreyna-mini-1.8b-v0.3.q2_k.gguf	q2_k	846.57 MB
neuralreyna-mini-1.8b-v0.3.q3_k_m.gguf	q3_k_m	1.02 GB
neuralreyna-mini-1.8b-v0.3.q4_k_m.gguf	q4_k_m	1.22 GB
neuralreyna-mini-1.8b-v0.3.q5_k_m.gguf	q5_k_m	1.38 GB
neuralreyna-mini-1.8b-v0.3.q6_k.gguf	q6_k	1.58 GB
neuralreyna-mini-1.8b-v0.3.q8_0.gguf	q8_0	1.96 GB

Original Model Card:

NeuralReyna-Mini-1.8B-v0.3

Description

Taken aloobun/Reyna-Mini-1.8B-v0.2 and further fine-tuned it using DPO using the argilla/OpenHermes2.5-dpo-binarized-alpha.

This model has capabilities in coding, math, science, roleplay, and function calling.

This model was trained on OpenAI's ChatML prompt format.

Evaluation

Coming soon

Contributions

Thanks to @aloobun and @Locutusque for their contributions to this model.

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	41.77
AI2 Reasoning Challenge (25-Shot)	35.58
HellaSwag (10-Shot)	61.13
MMLU (5-Shot)	44.22
TruthfulQA (0-shot)	41.99
Winogrande (5-shot)	60.93
GSM8k (5-shot)	6.75