Mistral-7B-OpenOrca-GGUF/README.md

license, language, library_name, pipeline_tag, tags, base_model, inference

license	language	library_name	pipeline_tag	tags	base_model	inference
apache-2.0	en	transformers	text-generation	mistral conversational text-generation-inference	Open-Orca/Mistral-7B-OpenOrca	false

Mistral-7B-OpenOrca-GGUF

• Quantized version of Mistral-7B-OpenOrca
• Created using llama.cpp

Available Quants

• Q2_K
• Q3_K_L
• Q3_K_M
• Q3_K_S
• Q4_0
• Q4_K_M
• Q4_K_S
• Q5_0
• Q5_K_M
• Q5_K_S
• Q6_K
• Q8_0