mradermacher/Mistral-7B-Heretic-V2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Mistral-7B-Heretic-V2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-25 07:14:15 +08:00
commit ea935c9aea
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Mistral-7B-Heretic-V2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Mistral-7B-Heretic-V2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c4fd57cf5fbc05237fd4776ee3853bed7564dbbd7a9333eafb2743be13402867
size 1757668224

3
Mistral-7B-Heretic-V2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80adb2fef1ab86e0ff3a53d1c9cf3e44617013b350c420e452426e549d47ae41
size 1615324032

3
Mistral-7B-Heretic-V2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5de35e368395fae7e1955b9aa4d1cf9dad64a03592cc0a31f6588bf2c1c1b8df
size 2504254336

3
Mistral-7B-Heretic-V2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b617d5e433e56747b329b1179665d44337b01a639bf44bb0d8abc936fff0ef8a
size 2314462080

3
Mistral-7B-Heretic-V2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:886e0762cdc25746623b5a0dbb943e754522720dd5fba05a3fda4cd54ec861d9
size 2201478016

3
Mistral-7B-Heretic-V2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:371e5bb3b4da26c62a7028b2e8f75e74a06ed603f58eb91c0229399d29f579fb
size 1994908544

3
Mistral-7B-Heretic-V2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f6750a191303396ced8694e4c7f049a9e6f27bdcfa7c53e87abfb137577601e
size 3288851328

3
Mistral-7B-Heretic-V2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fc1b7c133c80f368ce417d0a4ec6ac150983721e291ab4e78dc994e1f0d1762
size 3186353024

3
Mistral-7B-Heretic-V2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d527a2939f25b26faec5456053e795a72e19996347a85233c303868954653c70
size 3022775168

3
Mistral-7B-Heretic-V2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:939cb7dd0ff84af33b5b6cb898546897186b85791691a016c01892545ce88089
size 2830885760

3
Mistral-7B-Heretic-V2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c92eef57aedd44cd49dfc2f7954f5ef0ae17098807d7ac19855092a09e41ec83
size 4130071424

3
Mistral-7B-Heretic-V2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be863e233385787935ca69f9d9a845f4a7284b8af099c23fbf9030c49775426a
size 3911967616

3
Mistral-7B-Heretic-V2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:657c90174fdc3de4a7bb58553d104e8c25ac1c80cd015b41bc8bb7f95336edc7
size 2722882432

3
Mistral-7B-Heretic-V2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7d6be5f25f94318e81e9ad158dd6a931603c69802f038cb37d88fc51e45704f
size 2532565888

3
Mistral-7B-Heretic-V2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6e2f1f7b011dd7296e8a30eb11c60d34ce650d98dd253b415061ed2390c5819
size 3825984384

3
Mistral-7B-Heretic-V2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9767e2ca5c9b712dd05e1df303572eac5dee8ec20f3bfc79017a786c043f1e5
size 3522945920

3
Mistral-7B-Heretic-V2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3763f33bbf30b45d028f73fe65ebb861d59a633d9b29664a3f5ea265c54866d3
size 3168527232

3
Mistral-7B-Heretic-V2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a41e6d1219b093bfb35e0e20695d80f3d9dce83d80c1687969b0ab9df537dacb
size 4127974272

3
Mistral-7B-Heretic-V2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f162c4e9cf4e3f054408fd2d3bf3588e63bca3758afe6b5215a8114a13d49996
size 4557890432

3
Mistral-7B-Heretic-V2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc82b3760e76429ffc375d3d3936c508aeb977db3da5467e9d0d7a2b674e206b
size 4372816768

3
Mistral-7B-Heretic-V2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7d16f6f370cc56f5ef08183fdd1e7567b57515015e05909f7a0de3a00bc13b1
size 4144751488

3
Mistral-7B-Heretic-V2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4517121cc82d188d4393883a5b69fb81cd55986929f096514bff86c28ea11703
size 5136180096

3
Mistral-7B-Heretic-V2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cdf89c6be001ceb4ba2736690324e30a699c1cb636c6461fce72d5b11f6b288
size 5002486656

3
Mistral-7B-Heretic-V2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c681cb313ff58f545f97b1a01f10fe5667bbd87d3569fb5ec20b8261e678359
size 5947253632

3
Mistral-7B-Heretic-V2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a6b3924c5b6538f1e87656d6be85a93b0255f07424cb05605b326fb9c16b6ac
size 5015200

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: DogOnKeyboard/Mistral-7B-Heretic-V2
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- vllm
- mistral-common
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/DogOnKeyboard/Mistral-7B-Heretic-V2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Mistral-7B-Heretic-V2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q4_0.gguf) | i1-Q4_0 | 4.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q4_1.gguf) | i1-Q4_1 | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Mistral-7B-Heretic-V2-i1-GGUF/resolve/main/Mistral-7B-Heretic-V2.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->