RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-04 05:06:16 +08:00
commit 80435ba531
24 changed files with 187 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Holodeck-1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Mistral-7B-Holodeck-1.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:601d3c107e508db4938b4c1cf6e1a44cc311b25d60c89a1cfe39c463b1d93ea7
size 3284891840

3
Mistral-7B-Holodeck-1.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4135fc93eb3f0bad63eac3ac738ead34d4ac611fde01a73d09e661a0128be1f5
size 3182393536

3
Mistral-7B-Holodeck-1.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9655b5c64e4bb1473e247177aae88f2e3b97db73682bfd78946ac0d4b7e5e49f
size 3018815680

3
Mistral-7B-Holodeck-1.IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a34acf4a2ff94a2d5319d2851e5fb58ec932f7648567e5d6c9274c07e4961188
size 4155054272

3
Mistral-7B-Holodeck-1.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97d5960ceee7c5517f1421eb78b5ddcd8bf18f8ea0e11df56c6c435b4f234971
size 3944388800

3
Mistral-7B-Holodeck-1.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d75c91f55bed9513c861033e970a94f01d4c832c8cac31435439b87f7febd01
size 2719242432

3
Mistral-7B-Holodeck-1.Q3_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99d114cfdd4116abdbd6d2f3a5a41d73577a89b6c2a42b0264b0ffd60f0d887a
size 3518986432

3
Mistral-7B-Holodeck-1.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e643025ab032117ae3d39d65d0c75ecbbeb1e55a983c9da31c96d638b5c893b1
size 3822024896

3
Mistral-7B-Holodeck-1.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99d114cfdd4116abdbd6d2f3a5a41d73577a89b6c2a42b0264b0ffd60f0d887a
size 3518986432

3
Mistral-7B-Holodeck-1.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2a1e0fab93ce132f933a3ec672226490e89a5a413229d97bc8d763b77ea7ae0
size 3164567744

3
Mistral-7B-Holodeck-1.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e418faf34af1ca9f1c0c697c7f5b64ddea9c5960eb29ee939f15d1abbc1bb75
size 4108916928

3
Mistral-7B-Holodeck-1.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbbd85217a1ffd536af579431f47960b5c5922a996cd71bcff1d658e7202e1cd
size 4553316544

3
Mistral-7B-Holodeck-1.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cde77f8f348da9fb095b7c0582e08f0c5eb99cdfa1f35a0b9efbb6a5ea865d1b
size 4368439488

3
Mistral-7B-Holodeck-1.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cde77f8f348da9fb095b7c0582e08f0c5eb99cdfa1f35a0b9efbb6a5ea865d1b
size 4368439488

3
Mistral-7B-Holodeck-1.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3661aae5b019d5d3c7c82991614aab966ff59df1b59ed874498cc3efde0803cc
size 4140374208

3
Mistral-7B-Holodeck-1.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:306f6b15b17e217069a5d2fbf3eda76ad14a43c9106983919b3078faea655634
size 4997716160

3
Mistral-7B-Holodeck-1.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cb5c392b227d6d04966ccd5e61768b827814fcccbe5c87ac52715baaf004b75
size 5442115776

3
Mistral-7B-Holodeck-1.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aceadf793dddae0a099ffa4b7a5ff72a96fc4c8cd911df407ef52acb0287d718
size 5131409600

3
Mistral-7B-Holodeck-1.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aceadf793dddae0a099ffa4b7a5ff72a96fc4c8cd911df407ef52acb0287d718
size 5131409600

3
Mistral-7B-Holodeck-1.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b99483426f0fdead9865cc1f91cd3a3cc83b38a93058c0ada4741e11f00608d
size 4997716160

3
Mistral-7B-Holodeck-1.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b5ac50b2defde84299b48aff5387c687e4a3621c9eafbecfd6ddfb8b56fd847
size 5942065344

3
Mistral-7B-Holodeck-1.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05b04f2cbeee9faf73e08acea5869a7b873c9e8a86e17b09676dc5976201dbfa
size 7695857856

64
README.md Normal file
View File

@@ -0,0 +1,64 @@
Quantization made by Richard Erkhov.
[Github](https://github.com/RichardErkhov)
[Discord](https://discord.gg/pvy7H8DZMG)
[Request more models](https://github.com/RichardErkhov/quant_request)
Mistral-7B-Holodeck-1 - GGUF
- Model creator: https://huggingface.co/KoboldAI/
- Original model: https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1/
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [Mistral-7B-Holodeck-1.Q2_K.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q2_K.gguf) | Q2_K | 2.53GB |
| [Mistral-7B-Holodeck-1.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.IQ3_XS.gguf) | IQ3_XS | 2.81GB |
| [Mistral-7B-Holodeck-1.IQ3_S.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.IQ3_S.gguf) | IQ3_S | 2.96GB |
| [Mistral-7B-Holodeck-1.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q3_K_S.gguf) | Q3_K_S | 2.95GB |
| [Mistral-7B-Holodeck-1.IQ3_M.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.IQ3_M.gguf) | IQ3_M | 3.06GB |
| [Mistral-7B-Holodeck-1.Q3_K.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q3_K.gguf) | Q3_K | 3.28GB |
| [Mistral-7B-Holodeck-1.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q3_K_M.gguf) | Q3_K_M | 3.28GB |
| [Mistral-7B-Holodeck-1.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q3_K_L.gguf) | Q3_K_L | 3.56GB |
| [Mistral-7B-Holodeck-1.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.IQ4_XS.gguf) | IQ4_XS | 3.67GB |
| [Mistral-7B-Holodeck-1.Q4_0.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q4_0.gguf) | Q4_0 | 3.83GB |
| [Mistral-7B-Holodeck-1.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.IQ4_NL.gguf) | IQ4_NL | 3.87GB |
| [Mistral-7B-Holodeck-1.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q4_K_S.gguf) | Q4_K_S | 3.86GB |
| [Mistral-7B-Holodeck-1.Q4_K.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q4_K.gguf) | Q4_K | 4.07GB |
| [Mistral-7B-Holodeck-1.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q4_K_M.gguf) | Q4_K_M | 4.07GB |
| [Mistral-7B-Holodeck-1.Q4_1.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q4_1.gguf) | Q4_1 | 4.24GB |
| [Mistral-7B-Holodeck-1.Q5_0.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q5_0.gguf) | Q5_0 | 4.65GB |
| [Mistral-7B-Holodeck-1.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q5_K_S.gguf) | Q5_K_S | 4.65GB |
| [Mistral-7B-Holodeck-1.Q5_K.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q5_K.gguf) | Q5_K | 4.78GB |
| [Mistral-7B-Holodeck-1.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q5_K_M.gguf) | Q5_K_M | 4.78GB |
| [Mistral-7B-Holodeck-1.Q5_1.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q5_1.gguf) | Q5_1 | 5.07GB |
| [Mistral-7B-Holodeck-1.Q6_K.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q6_K.gguf) | Q6_K | 5.53GB |
| [Mistral-7B-Holodeck-1.Q8_0.gguf](https://huggingface.co/RichardErkhov/KoboldAI_-_Mistral-7B-Holodeck-1-gguf/blob/main/Mistral-7B-Holodeck-1.Q8_0.gguf) | Q8_0 | 7.17GB |
Original model description:
---
license: apache-2.0
language:
- en
pipeline_tag: text-generation
inference: true
tags:
- pytorch
- mistral
- finetuned
---
# Mistral 7B - Holodeck
## Model Description
Mistral 7B-Holodeck is a finetune created using Mistral's 7B model.
## Training data
The training data contains around 3000 ebooks in various genres.
Most parts of the dataset have been prepended using the following text: `[Genre: <genre1>, <genre2>]`
```
### Limitations and Biases
Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).