34 lines
496 B
Markdown
34 lines
496 B
Markdown
---
|
|
license: apache-2.0
|
|
language:
|
|
- en
|
|
library_name: transformers
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- mistral
|
|
- conversational
|
|
- text-generation-inference
|
|
base_model: Open-Orca/Mistral-7B-OpenOrca
|
|
inference: false
|
|
---
|
|
|
|
|
|
# Mistral-7B-OpenOrca-GGUF
|
|
- Quantized version of [Mistral-7B-OpenOrca](https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca)
|
|
- Created using llama.cpp
|
|
|
|
## Available Quants
|
|
|
|
* Q2_K
|
|
* Q3_K_L
|
|
* Q3_K_M
|
|
* Q3_K_S
|
|
* Q4_0
|
|
* Q4_K_M
|
|
* Q4_K_S
|
|
* Q5_0
|
|
* Q5_K_M
|
|
* Q5_K_S
|
|
* Q6_K
|
|
* Q8_0
|