base_model, inference, model_creator, model_name, pipeline_tag, quantized_by, tags

base_model	inference	model_creator	model_name	pipeline_tag	quantized_by	tags
NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3	false	NickyNicky	LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3	text-generation	afrideva	gguf ggml quantized q2_k q3_k_xs q3_k_m q4_k_m q5_k_m q6_k q8_0

NickyNicky/LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3-GGUF

Quantized GGUF model files for LocutusqueXFelladrin-TinyMistral248M-Instruct_oasst2_chatML_V1_DPO_V3 from NickyNicky

Name	Quant method	Size
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.fp16.gguf	fp16	496.82 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q2_k.gguf	q2_k	105.46 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_xs.gguf	q3_k_xs	115.32 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q3_k_m.gguf	q3_k_m	129.03 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q4_k_m.gguf	q4_k_m	155.67 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q5_k_m.gguf	q5_k_m	179.23 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q6_k.gguf	q6_k	204.26 MB
locutusquexfelladrin-tinymistral248m-instruct_oasst2_chatml_v1_dpo_v3.q8_0.gguf	q8_0	264.33 MB

Original Model Card: