mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-13 16:41:11 +08:00
commit 2ce76c6a3f
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
JOSIE-IT1-Qwen3-0.6B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c320f07f01ba234c00adf34cf7c5156a75780b023d083e480e0351d2afbc09b7
size 216052000

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80ad4ce97655eef46b20cb3e9487e95a2ca34650d962b0a5c79a139cbc2649bb
size 208015648

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:669bd35255b9dcd0eb25c4d7cb3331f762b6440237ab4c4e2fff23e80aebdfe1
size 264909088

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07ea7c216e0099bf963781ffe7140bf835176b91cea4228247664d57f66ee381
size 254193952

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cfa8d25d0919cae126013b5f07a5ac9cabfeee2434fd0006d7bc7bcedc97bb8
size 241996064

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6e4d426023d68c3f1194fdc74d2162235086c92c28ccafa2405472ab8c25fad
size 229445920

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e154f6edf79766ef2233bd2ded8c09c216730692ed9581fff931637dc16fe4f2
size 336026912

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7e6a9c10c47987a4c477c0e15bcde61178b7898bd57c3fcb56241f825b71370
size 323075360

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d4fa00afdde29a7ba7fe0f175d4648db2e755ce0d1cb7b0061cbc4c88b5cd2c
size 312753440

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b9a11f865be11f5bab18f3f9c19ba431b0c03b4ae3a638fdd1698f6e880df83
size 279015712

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96aad045b15637a3db998c608f2d24a1931ab44bc7d294136867daa2c9d35db3
size 381566240

3
JOSIE-IT1-Qwen3-0.6B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:933a4ed5ec764955409d2bab4ed54b1e1209966a4ec4974ca027436848a44828
size 367803680

3
JOSIE-IT1-Qwen3-0.6B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e3d14688934a074d1ac80442aaa00a38a21978ab1929bfe08181015c301398c
size 296238368

3
JOSIE-IT1-Qwen3-0.6B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5aefabdfe5758ce29ec90d18f5a394a07c60307318b086c87ab94a704a26ccc8
size 280558880

3
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0129929e027500df8dbd49fa62590d211e99f0893cf435ea74bf855d77aca687
size 368491808

3
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da12c209573362546ba2dbe1dfd57dc7b0104be496c1e3a8502a8ffc07497253
size 347127072

3
JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9126e6cdc684a5a70402688d917c2f88cba9facbe3c58facbf93c434ef7522e3
size 323075360

3
JOSIE-IT1-Qwen3-0.6B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d15b9447b4487a89c20c0014e60b55b5c5f9e7a396737ac24f37bf1f1b0dcbd
size 382156064

3
JOSIE-IT1-Qwen3-0.6B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23141cd9bbb3a01b0a1d2795b81752f2d2e875daf3df62ccfc32b8f7440d6761
size 409091360

3
JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f71598a2260439e4f04e1665c489808797aac2e9de89f52645c93869d5e294c6
size 396705056

3
JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b4c6ff9f37a52532ee8a7e418848a5db793392af8a85703600c16540587b81a
size 383270176

3
JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9d2016fef3ab85839916a37fc1700343c9a9f4b295c53989c68e602b19a3485
size 444415264

3
JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67c10862c9d6a11e9185c9660266024f0dc998921d57ca64fb4821c58ed4219d
size 436616480

3
JOSIE-IT1-Qwen3-0.6B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40437c4be03fda7dd562d81be7e056222c4298328d5a8eddb6fb6e1c0c6dfb61
size 495107360

3
JOSIE-IT1-Qwen3-0.6B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0f232ef115cefdaa854bd3ae4e1f76ab87f05cfc6598f1d26ac5bf48b789224
size 1177056

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Goekdeniz-Guelmez/JOSIE-IT1-Qwen3-0.6B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Goekdeniz-Guelmez/JOSIE-IT1-Qwen3-0.6B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#JOSIE-IT1-Qwen3-0.6B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q4_0.gguf) | i1-Q4_0 | 0.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/JOSIE-IT1-Qwen3-0.6B-i1-GGUF/resolve/main/JOSIE-IT1-Qwen3-0.6B.i1-Q6_K.gguf) | i1-Q6_K | 0.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->