mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-10 14:34:10 +08:00
commit 6e742dcd0d
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Deneb-Qwen3-Radiation-0.6B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f948dce00c642ced6753034b60ebb878d159f371ea7584c050ee209cdd82088c
size 216052608

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1b41d3af1f7ebaac00cc06c54ec83b0c2020e4bb126ac57f32488463ed676dc
size 208016256

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f27c7f978a606911801190f83e7819870a31b38de6c6ec0be8536cd3c3bdd668
size 264909696

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf2da5013ec03880d3083671d8519444d18926c628747e82b4d067f42dc2ace8
size 254194560

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:605b3838837aba71e4d96c7dbe25448482f50627ee5b8db1aedffce29d4707fa
size 241996672

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c955188f44b7def16c287f4f5b9b883a745dc7e811b7a3c14e65f7bde6e5b51
size 229446528

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7ee62fd3d6816cf3c63aab0ec0bf0f2469fd169deeb9193bb89d215b917a1eb
size 336027520

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e29fd6a3c7786893accc40de6aad928ff97e274b3836ba1f2c3749546b63882
size 323075968

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2c9d7d5781b41d77c27e253ee7b6458446194791e0645dda668bdeb4e6783b1
size 312754048

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88088813dea784733fdb40754d37053e1470cf80289991313140dc1bf61b433b
size 279016320

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9eade440fa7aa0cd02b560d866d71401b32a4b0dde8c48bc28e6aba7411fb23e
size 381566848

3
Deneb-Qwen3-Radiation-0.6B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f8bed0228baefd8892b64212b8e89a9b07b5dc0933959564ca95a242a75ba68
size 367804288

3
Deneb-Qwen3-Radiation-0.6B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74dd0f627e052909ef9a8ba060f3d4eea470581ac8b73655858e06562f92caa6
size 296238976

3
Deneb-Qwen3-Radiation-0.6B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98e210bafd6fa42d4d6fdca86cc4689b06fad9c02fe32f1164c5982ef2eec00b
size 280559488

3
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e41b2307f8457a24e57d05233fb0c2d7390f258f04a1d3a5c28834db9881fcdc
size 368492416

3
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a54fab4672b116bb0b4e7e7a28d5a5adff9676e13b094b43b2f36ec886c304d
size 347127680

3
Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bca4ca7f4f872faab4b8cded2157324b7083f97bafa6e11700f9161cef4b12df
size 323075968

3
Deneb-Qwen3-Radiation-0.6B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:419b2a52778b938e57bd562de56aeb38fa5e254fdfa2ac96d8ab4f6b312a0f1e
size 382156672

3
Deneb-Qwen3-Radiation-0.6B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50300074b0a55b90d3609a404b5e4c0fa81e707dbcd84f70b8c6afcd0c99b76f
size 409091968

3
Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05b681557c571a2b14c269245be189051ffc32e24071b988d72829ab2634bca6
size 396705664

3
Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:778f1001778e7170fa86fca18fa017d12846447591bc4e8125609110a7adfb40
size 383270784

3
Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed275a376a1d37400bec1796f2ed01d0bea18018bc463a17d3412ba098347a5a
size 444415872

3
Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78a1f3a3e5f4b4733ec49e9cb35c096d746722448a0e60117ac17897b371bdff
size 436617088

3
Deneb-Qwen3-Radiation-0.6B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2e74034b2b7ec341e09f178c60b395c889ff29362ada6a95f121028b50d92d62
size 495107968

3
Deneb-Qwen3-Radiation-0.6B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74c76a213fbacbf22ae37070a0f4f2223f6c811b2bc24ae28fb4143aaaa17155
size 1177056

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: prithivMLmods/Deneb-Qwen3-Radiation-0.6B
language:
- en
- zh
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- multilingual
- polished
- Abliterated
- math
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/prithivMLmods/Deneb-Qwen3-Radiation-0.6B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Deneb-Qwen3-Radiation-0.6B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Deneb-Qwen3-Radiation-0.6B-i1-GGUF/resolve/main/Deneb-Qwen3-Radiation-0.6B.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->