初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-23 00:57:09 +08:00
commit a8ba7ee4fc
27 changed files with 226 additions and 0 deletions

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen3-4B-Instruct-2507-heretic-av2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:246ac8d6240c05e1e94a9acf9c51633ac236715bfa3da13d859527e40a622877
size 1127016960

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b0979fa229caa6d3b323e47947651d017e96ea187db947556e9ada3e799910f
size 1055255040

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49cf6522b90b59305fe3a23aa16dea03d44e3694b0945e5f6e02f4620690a687
size 1512983040

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:142161a1fc71d3517ac0510a7d29baa05a6bebabfce09e9cb01f614e6ce68e55
size 1417300480

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68d7d5577c3085b92b765d37141a07b3fa9ba540152978f5dd631ccaa40e4ccd
size 1354099200

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5847a3a89b33a695fa53ebf0f961b772c44482ccd453b458d406c02f485f926
size 1246620160

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f4d3eab6524a0f2dbe7054602c4ceecac688a487b01a61081b1a11a96c67279
size 1962895360

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4d2ea1ea137595c74d9f3a4b978444181e820722e8bc5c7a2278fa60bdd1dcb
size 1899530240

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ce91c02a933fb356f1e4098e7fba6f69826e1234a9b36cb6e5957245237d69d
size 1814374400

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f98751d6362423f06aa7ee5f8a650917529efc63083fa0a928b44a21fbfddc2d
size 1670187520

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:804e8e02341ced8b02e6adbec4a5024557e6c16d720a3bd62acc880dc7782e6f
size 2381342720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c2a028c793011183773c3ff074502c376a6e90540699dd26f7914d985448863
size 2270750720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86cbad7ef759a2f36c99d085ca1507e28de28c701c9c93a6cba10b1bb2cd18c8
size 1669498880

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e26338545fa1fd34569cc22ca647cb6eeba6724eea40a6fd819006495e65fc0c
size 1563453440

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:051bd0715535654b35292c076ffd634153a47d320800850597ca2462485fd5d3
size 2239784960

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1b5b9963b11dd8341e0231235373867f9c289eb7f4f717ef1b80a28d98eee0e
size 2075617280

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8069c656133ecdcc85acf4632e413c67135ee01c63e4d40692e922fbcf99a75f
size 1886996480

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1a0cae48dee4dc8eea7a0fa0e3824147dfe192e0f27d476a9f99ff99c29ec44d
size 2375772160

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84d049dc0c7aa1304f9cf760120b46d3354cb5d0fdc5f02d0025c37d8d54377f
size 2596628480

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dcf356ef3bc5f68299b33675ac1090bfd915ce8c1d50cb7e62ef2dd776453fd5
size 2497280000

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24146c68dab9691e5113dae275dd48bca28c6ce181508254cbd850eda363c623
size 2383308800

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8324ec71b568df348897533384e76ddab7d627023ac408bf124bb231913436ee
size 2889512960

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53f427ea6f4d343530c33c69e46b14c1a6238757913865ba00b04afadc179550
size 2823710720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70d8c22239c111623426766bdaf28e90e8144728959b5dfaf3241a730acf9818
size 3306260480

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:178573aa7e140cf939d661585a1c6d134980b85b15a0e58af7c37ea6e5e279ed
size 3872640

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: arnomatic/Qwen3-4B-Instruct-2507-heretic-av2
language:
- en
library_name: transformers
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507/blob/main/LICENSE
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- heretic
- uncensored
- decensored
- abliterated
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/arnomatic/Qwen3-4B-Instruct-2507-heretic-av2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-av2-i1-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-av2.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->