mradermacher/MN-Raven-12B-v1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MN-Raven-12B-v1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-09 07:54:19 +08:00
commit 41b317593a
27 changed files with 236 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
MN-Raven-12B-v1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
MN-Raven-12B-v1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d55ce71e0c3630d6d8a78398a3f8bbc8c719cb72511cab712a95cf3ecedb5570
size 3221628992

3
MN-Raven-12B-v1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5292590eef2b1b1a15fa09fff90d0be4fe56babab544a654a6dcaea4fe09a607
size 2999216192

3
MN-Raven-12B-v1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5e9d924665d016dcd92a8654a2419dcecf856bec368551daadd75ffeb4601aa
size 4435028032

3
MN-Raven-12B-v1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35628872057783e14c007dacb8cf9545ba86610e7dbeceb640c85b51db49167e
size 4138477632

3
MN-Raven-12B-v1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75331dae24e0fd1703b1ac3a2885ff75312ffbbb15d060526c3c97ddef45b169
size 3915081792

3
MN-Raven-12B-v1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c61fcc1ea13fa75ceb18d8d2469736a30c528851ef2250f507f21e18f69d6dc6
size 3592316992

3
MN-Raven-12B-v1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af85558311ef5e5a1ba0633daaf5c6cafdb3db359128089da365ce04def08251
size 5722236992

3
MN-Raven-12B-v1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f7004d760d313accaeca9224e82a4c720605db91b6bea2c4770b6bc1ddc6d2c
size 5562083392

3
MN-Raven-12B-v1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38812ba4bec4e325654b94882804123d14ffcb31651430fe6a88a5dbdff951b1
size 5306492992

3
MN-Raven-12B-v1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:acba67c64311d56db38cec29862bce56fb54f0bbeb0542be38d45fbdf37a021d
size 4945389632

3
MN-Raven-12B-v1.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b56b219c2b30038df2d87259d69b03e27f74e57f7f292c70c020c6358563de58
size 7097919552

3
MN-Raven-12B-v1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f6af23844ac119bd32a895fbae98d28cf4b6d8dfaaae75795c12706d442d9527
size 6742714432

3
MN-Raven-12B-v1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf09db55752ca72f9891e5823d6648961d0c900ff59df6eb5e302800c5a29d32
size 4791052352

3
MN-Raven-12B-v1.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df8678e5c90b5b9ccfe49ba4e413077666b094e67fd52056f044977ee4deea0b
size 4493682752

3
MN-Raven-12B-v1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0a44d110c8a5784b98fedb46ee2a787ee13c44926b091606681e00270d4558d
size 6561507392

3
MN-Raven-12B-v1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67d6a422ccb912757723f530b67fd4ff24f97ec5c13bf101a4afa1e314e58120
size 6083094592

3
MN-Raven-12B-v1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b4f4e40f6a0ba96fe4d9fe19d9e6be3e2235425372f41dba45956eb939e9110
size 5534230592

3
MN-Raven-12B-v1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59051f654016a80288c2a34a3142a6f3accbbc20f4065c666d9f05d330a494e8
size 7094642752

3
MN-Raven-12B-v1.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cadeb2ef3adf5bc3cde9d5512af3287d46af5e4049857b4a562feb9e915731e
size 7795222592

3
MN-Raven-12B-v1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0b68e93b61f4d02b1687b9a8666f3a78e75f7d2a0b31eb95a98e0914536b1a7
size 7477209152

3
MN-Raven-12B-v1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1feaacb6e990a79401968652c7d08d120780517244b54b3fcf9a768d33087f4a
size 7120201792

3
MN-Raven-12B-v1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0900347a0340053be809eecf26ba5ff06eeced797226fe640da3e67b14aefd10
size 8727636032

3
MN-Raven-12B-v1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed4ed2b495cfce9c914662a49c6a40bd85205b58a3f44ec6533e41a1b3c6e9ca
size 8518740032

3
MN-Raven-12B-v1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8116ea94268b7b1ce399db9e1e038dcca30c4e9e5be39da38beca5b648a4834a
size 10056214592

3
MN-Raven-12B-v1.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:581950e64e8a48650beacbe8a51621a140cec94297adeb5748945d692cf71450
size 7088192

101
README.md Normal file
View File

@@ -0,0 +1,101 @@
---
base_model: DarkArtsForge/MN-Raven-12B-v1
datasets:
- DarkArtsForge/Poe_v1
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- axolotl
- finetune
- creative writing
- roleplay
- uncensored
- gothic
- poe
- raven
- 12B
- merge
- mergekit
- mistral-nemo
- arcee_fusion
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DarkArtsForge/MN-Raven-12B-v1
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MN-Raven-12B-v1-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/MN-Raven-12B-v1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/MN-Raven-12B-v1-i1-GGUF/resolve/main/MN-Raven-12B-v1.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->