初始化项目，由ModelHub XC社区提供模型
Model: mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3aad3c61ebee01359290701a7ad7d1ff556f2563c5f9ab66099082caaf265bad
|
||||
size 1127018080
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7a4d262f0006d593062e5f719c1074804b5ae8c60db82c175a39f2bfa1a3cdf9
|
||||
size 1055256160
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:37c89419dcda4125de8367672f68f69bc25d2709329873780e920846297646c3
|
||||
size 1512984160
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ae6cb6dc06bfae6dcffc8a12c490947fb7752f5f446bb9eabd415609ffff68ff
|
||||
size 1417301600
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:540875e09e45c284b164c63e5175057dc6d87f97ff790502999e581105699536
|
||||
size 1354100320
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7e4e5d23da064b9d623a51ff31ca0ebb12bd58df795d900dd3cf3e9516a6189a
|
||||
size 1246621280
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0e93c914552921897e215416d57fafeec6dd02daf6d8d16f296148542d31ee60
|
||||
size 1962896480
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:64b5ef4cd78a8d122b6b8999746184150c12951741fd5b35e1507c092291533e
|
||||
size 1899531360
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:15505900ee05291d34276fb5796f7b9978751dbac12ebd474edaf8069886f481
|
||||
size 1814375520
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:23537865a4d410123544cbe7dff9968d4f61172f5844d986811231fe82639a49
|
||||
size 1670188640
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:58aabec0c9299a612a71d2ec56f7c4a92fd3624a4fab7035b6f8693663394838
|
||||
size 2381343840
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:45e28e7a4c07db0d951355d32658efcea5832bfe6fc84704f587d71161e9f272
|
||||
size 2270751840
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d521ef75efbaf71d7b283e683a931da8e39f497b44a08c0ae03fa564f5079c9e
|
||||
size 1669500000
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a60dcf7e6d0da3e4fe9e1c385b2b55341e4aa48496f37092b7ce251732abd55f
|
||||
size 1563454560
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0d0d96ab573e5552cece02cb040a1cff2b620134a32ecd8ce44c7133ad91d1cf
|
||||
size 2239786080
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2f870e97b2ed810d63073b1e67e6c5f645c19a42526e079814483526f4c9b8ae
|
||||
size 2075618400
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:76758a0fac57bef57af6e9dea7619b6f2870a48f74b87305ba8511c758b8cc3c
|
||||
size 1886997600
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6bce409d0c8a93a23e77bddecabfc9ceae811a20a4f882f34049bb9027ffaef4
|
||||
size 2375773280
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ca7d13e765d960e7ec03f32df5bbaa75833752a78c06e4ad122473eea98306b1
|
||||
size 2596629600
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:61b427ddc00cdd794a716ca47eaf248332a12c3ba0f72b7dbe513ef7e709ed5a
|
||||
size 2497281120
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1e8992a8005172f2c95f51d4ed9c41b722e4fba5531948b0485821ece31b1f8c
|
||||
size 2383309920
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:08768391430b41ecbc4080194c663fd6ba9d51c0bfef7af8865d64b2b52f1055
|
||||
size 2889514080
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c2e80e16a50630f28aed72d5052d11633faa9336390233a5a15cb22be5dfdd44
|
||||
size 2823711840
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:977cde78c76711ad3bb9d177ef898625ec7d0d4e559fc1432b931400708d5972
|
||||
size 3306261600
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0b929096231613d2671e0ca603640c7b9fa04314d847adc2abf14e83562717da
|
||||
size 3872640
|
||||
84
README.md
Normal file
84
README.md
Normal file
@@ -0,0 +1,84 @@
|
||||
---
|
||||
base_model: Goekdeniz-Guelmez/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/Goekdeniz-Guelmez/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 1.2 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 3.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2-i1-GGUF/resolve/main/Josiefied-Qwen3-4B-Instruct-2507-gabliterated-v2.i1-Q6_K.gguf) | i1-Q6_K | 3.4 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user