commit 5cda1cfa11feab6cadaef677cd24606dba585044 Author: ModelHub XC Date: Thu Jul 23 02:01:09 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e0ae6ee --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-4B-Instruct-2507-heretic-v4.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.IQ4_XS.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.IQ4_XS.gguf new file mode 100644 index 0000000..e0d5989 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ad5ff359d5ae9af2a439c802dc1f7afccebba340c82972c1d961d8a1d4639b66 +size 2286315232 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q2_K.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q2_K.gguf new file mode 100644 index 0000000..9abf713 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:678c45a1ef2b26d4397b517aed4bbd16fffdc10dd73b0f804a1e046b386cbe87 +size 1669498592 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_L.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_L.gguf new file mode 100644 index 0000000..e296b4d --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9ab5387ad217279672504b9f915dd54d5641ffd463186a557ed1d1780291b634 +size 2239784672 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_M.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_M.gguf new file mode 100644 index 0000000..7344c66 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:26320aecc66c210f1728c483244e509346f6dd95650c9a94e869c2fe1bf4b70e +size 2075616992 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_S.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_S.gguf new file mode 100644 index 0000000..b15cff9 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7580d47ca719da06313fbce2bd7ce3d654756e0cea1919bce8e8eea39f529491 +size 1886996192 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_M.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_M.gguf new file mode 100644 index 0000000..9a2b68c --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90842a5af626e804660ac25215a07058641c2c080090bea0d660014d4f72f828 +size 2497279712 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_S.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_S.gguf new file mode 100644 index 0000000..d656ca3 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:58485faf924a6474cf11e92d94e8f4e62347d4418415a539dc6be039f3b9e07b +size 2383308512 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_M.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_M.gguf new file mode 100644 index 0000000..46a6e24 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a83258541d350333b88acdb2087d764f78904dfc7f19145ef4997ffca51cb74e +size 2889512672 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_S.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_S.gguf new file mode 100644 index 0000000..7cef6df --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:213b4184fbd6d4aed915248fee9d33a7d17f9e50bbd39d7c6ea1919ad1afcd03 +size 2823710432 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q6_K.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q6_K.gguf new file mode 100644 index 0000000..8eed0f1 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:786602b7a1b15af97f2c95d140829308141a10b79fb7e61a5745b3d99d3a5f16 +size 3306260192 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.Q8_0.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.Q8_0.gguf new file mode 100644 index 0000000..4aceb51 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eac6f16f30571ecaeb03e9c72a756c2de8f83b5d17ec8971f8d3835b31c539ec +size 4280404192 diff --git a/Qwen3-4B-Instruct-2507-heretic-v4.f16.gguf b/Qwen3-4B-Instruct-2507-heretic-v4.f16.gguf new file mode 100644 index 0000000..88851c7 --- /dev/null +++ b/Qwen3-4B-Instruct-2507-heretic-v4.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0af5056debb2aae7daf330215ce5d0b58cc336838be18390830372d9bee5d8c3 +size 8051284192 diff --git a/README.md b/README.md new file mode 100644 index 0000000..5858056 --- /dev/null +++ b/README.md @@ -0,0 +1,78 @@ +--- +base_model: p-e-w/Qwen3-4B-Instruct-2507-heretic-v4 +language: +- en +library_name: transformers +license: apache-2.0 +license_link: https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507/blob/main/LICENSE +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- heretic +- uncensored +- decensored +- abliterated +--- +## About + + + + + + + + + +static quants of https://huggingface.co/p-e-w/Qwen3-4B-Instruct-2507-heretic-v4 + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-4B-Instruct-2507-heretic-v4-GGUF).*** + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q2_K.gguf) | Q2_K | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_S.gguf) | Q3_K_S | 2.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_M.gguf) | Q3_K_M | 2.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q3_K_L.gguf) | Q3_K_L | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.IQ4_XS.gguf) | IQ4_XS | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_S.gguf) | Q4_K_S | 2.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q4_K_M.gguf) | Q4_K_M | 2.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_S.gguf) | Q5_K_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q5_K_M.gguf) | Q5_K_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q6_K.gguf) | Q6_K | 3.4 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.Q8_0.gguf) | Q8_0 | 4.4 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Qwen3-4B-Instruct-2507-heretic-v4-GGUF/resolve/main/Qwen3-4B-Instruct-2507-heretic-v4.f16.gguf) | f16 | 8.2 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +