初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1f2c623dd6a1eb1dfb8cb7c1af91f972996e64cdca14864d7a91873c755770e1
|
||||
size 3849658432
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bcabb6d349c1d8f74eb5248f603b77ab82899160b96d6348481b42400fb974bc
|
||||
size 3579936832
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:02df2883cdff079b7d212e75fd10640b16c7e8cc76216f9916289e3f1b6cf7cc
|
||||
size 5322943552
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:486dd08521c4755250425905c7499bf3b5382a85c0f99ca1edfec9bb0a2623a9
|
||||
size 4963314752
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:96e9bd1ce8e13ea4865f4286750b17076dd68563ef8e87cc3580256158587f96
|
||||
size 4691591232
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:95b3d02204fce89c4f999360c01fc14eee595960f6f9a3de13695c847d66d071
|
||||
size 4299194432
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5c017c239b9fee453cd395072178455a0b616f39978e5ad2a5f85eb01476324a
|
||||
size 6883412032
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8e3a35eee7b43339065365abadae8c0a673ce879998d8030d20c625b66c148e2
|
||||
size 6684960832
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:38340324f959bfe76c77b5145ec824f940646e3e9539b8e745c89f872c5fa164
|
||||
size 6375303232
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:39613be8087edce1f9be6fe2f3a02d0243c5df5f36f78f8f38876d34af354ea6
|
||||
size 5942668352
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a4dac0c9f822455a6d582c021d00dd7c38021a5280e9d8b3104f7de59c887fb5
|
||||
size 8541365312
|
||||
3
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a6fd3c6349a1438f5371dbe92630a70eb086eb6497dac379c664e4c2d83a3d8f
|
||||
size 8110732352
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5e20c2f397001d19d0152ec05c18f710d8b6e616f5b0554a8a099b627bd0410b
|
||||
size 5753986112
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:34cbdbfc5a4c0e1443ba5e4d092932d12d125e84a715f113a6933fffae2bb8c8
|
||||
size 5389851712
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:00a8a9defb9fc8b74906af405554845e754b38f63b583f1d871b1119a9f24dbe
|
||||
size 7900653632
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:93cb4734d537fe6f27a7b746ffb2f848623cb362c3ed7c0e4b4d11eec6770dbd
|
||||
size 7321315392
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:645ba7f59dc3feccd092baf5c97a726ac899e711e2d2d993d675b765a29955a5
|
||||
size 6657108032
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f71436f1455475f26dba9a7a650468421ec9419eeb9b0f263842b6cdfa2556b6
|
||||
size 8543003712
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8f8b748632e262c7d6a55c4eff745772c72fb2caa1dba4cab6196b404f48b021
|
||||
size 9389524032
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2ef29dd099fe3aa7883f740980c2f0e4eae927ddfa0dd641c7f9fe21f457be2b
|
||||
size 9001755712
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5e14123c40c6d452b3172a08ffa3d24ef070f20298d638d857ccaad4b6074ce3
|
||||
size 8573477952
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d68c9b6efb51110675e6232168faa04e42fd64c8fc4f0272b3773280a876c0cb
|
||||
size 10514572352
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9a3aef2b15cf982a9be4ee1ceb371d7e72b7fe74dd45bcda6439cc263d7ec320
|
||||
size 10263897152
|
||||
3
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:00c4c9b1b55368a4438a614cc73cf4226695d84fedad1d4ecf04555b7e707324
|
||||
size 12121940032
|
||||
129
README.md
Normal file
129
README.md
Normal file
@@ -0,0 +1,129 @@
|
||||
---
|
||||
base_model: sequelbox/Qwen3-14B-Esper3Mix
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- esper
|
||||
- esper-3
|
||||
- dmind
|
||||
- dmind-1-mini
|
||||
- cobalt
|
||||
- cobalt-2
|
||||
- grayline
|
||||
- valiant
|
||||
- valiant-labs
|
||||
- qwen
|
||||
- qwen-3
|
||||
- qwen-3-14b
|
||||
- 14b
|
||||
- reasoning
|
||||
- web3
|
||||
- code
|
||||
- code-instruct
|
||||
- python
|
||||
- javascript
|
||||
- dev-ops
|
||||
- jenkins
|
||||
- terraform
|
||||
- scripting
|
||||
- powershell
|
||||
- azure
|
||||
- aws
|
||||
- gcp
|
||||
- cloud
|
||||
- problem-solving
|
||||
- architect
|
||||
- engineer
|
||||
- developer
|
||||
- creative
|
||||
- analytical
|
||||
- expert
|
||||
- rationality
|
||||
- math
|
||||
- math-reasoning
|
||||
- math-instruct
|
||||
- uncensored
|
||||
- unfiltered
|
||||
- amoral-ai
|
||||
- conversational
|
||||
- chat
|
||||
- instruct
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/sequelbox/Qwen3-14B-Esper3Mix
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-14B-Esper3Mix-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf) | i1-IQ1_M | 3.9 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0bbf0cadd5963c20650ae5f75fd54db9309c2be2030c9f783eff21f7468b6ec6
|
||||
size 7709765
|
||||
Reference in New Issue
Block a user