初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1f2c623dd6a1eb1dfb8cb7c1af91f972996e64cdca14864d7a91873c755770e1
|
||||||
|
size 3849658432
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bcabb6d349c1d8f74eb5248f603b77ab82899160b96d6348481b42400fb974bc
|
||||||
|
size 3579936832
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:02df2883cdff079b7d212e75fd10640b16c7e8cc76216f9916289e3f1b6cf7cc
|
||||||
|
size 5322943552
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:486dd08521c4755250425905c7499bf3b5382a85c0f99ca1edfec9bb0a2623a9
|
||||||
|
size 4963314752
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:96e9bd1ce8e13ea4865f4286750b17076dd68563ef8e87cc3580256158587f96
|
||||||
|
size 4691591232
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:95b3d02204fce89c4f999360c01fc14eee595960f6f9a3de13695c847d66d071
|
||||||
|
size 4299194432
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5c017c239b9fee453cd395072178455a0b616f39978e5ad2a5f85eb01476324a
|
||||||
|
size 6883412032
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8e3a35eee7b43339065365abadae8c0a673ce879998d8030d20c625b66c148e2
|
||||||
|
size 6684960832
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:38340324f959bfe76c77b5145ec824f940646e3e9539b8e745c89f872c5fa164
|
||||||
|
size 6375303232
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:39613be8087edce1f9be6fe2f3a02d0243c5df5f36f78f8f38876d34af354ea6
|
||||||
|
size 5942668352
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a4dac0c9f822455a6d582c021d00dd7c38021a5280e9d8b3104f7de59c887fb5
|
||||||
|
size 8541365312
|
||||||
3
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a6fd3c6349a1438f5371dbe92630a70eb086eb6497dac379c664e4c2d83a3d8f
|
||||||
|
size 8110732352
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5e20c2f397001d19d0152ec05c18f710d8b6e616f5b0554a8a099b627bd0410b
|
||||||
|
size 5753986112
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:34cbdbfc5a4c0e1443ba5e4d092932d12d125e84a715f113a6933fffae2bb8c8
|
||||||
|
size 5389851712
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:00a8a9defb9fc8b74906af405554845e754b38f63b583f1d871b1119a9f24dbe
|
||||||
|
size 7900653632
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:93cb4734d537fe6f27a7b746ffb2f848623cb362c3ed7c0e4b4d11eec6770dbd
|
||||||
|
size 7321315392
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:645ba7f59dc3feccd092baf5c97a726ac899e711e2d2d993d675b765a29955a5
|
||||||
|
size 6657108032
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f71436f1455475f26dba9a7a650468421ec9419eeb9b0f263842b6cdfa2556b6
|
||||||
|
size 8543003712
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8f8b748632e262c7d6a55c4eff745772c72fb2caa1dba4cab6196b404f48b021
|
||||||
|
size 9389524032
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2ef29dd099fe3aa7883f740980c2f0e4eae927ddfa0dd641c7f9fe21f457be2b
|
||||||
|
size 9001755712
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5e14123c40c6d452b3172a08ffa3d24ef070f20298d638d857ccaad4b6074ce3
|
||||||
|
size 8573477952
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d68c9b6efb51110675e6232168faa04e42fd64c8fc4f0272b3773280a876c0cb
|
||||||
|
size 10514572352
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9a3aef2b15cf982a9be4ee1ceb371d7e72b7fe74dd45bcda6439cc263d7ec320
|
||||||
|
size 10263897152
|
||||||
3
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf
Normal file
3
Qwen3-14B-Esper3Mix.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:00c4c9b1b55368a4438a614cc73cf4226695d84fedad1d4ecf04555b7e707324
|
||||||
|
size 12121940032
|
||||||
129
README.md
Normal file
129
README.md
Normal file
@@ -0,0 +1,129 @@
|
|||||||
|
---
|
||||||
|
base_model: sequelbox/Qwen3-14B-Esper3Mix
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: apache-2.0
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- mergekit
|
||||||
|
- merge
|
||||||
|
- esper
|
||||||
|
- esper-3
|
||||||
|
- dmind
|
||||||
|
- dmind-1-mini
|
||||||
|
- cobalt
|
||||||
|
- cobalt-2
|
||||||
|
- grayline
|
||||||
|
- valiant
|
||||||
|
- valiant-labs
|
||||||
|
- qwen
|
||||||
|
- qwen-3
|
||||||
|
- qwen-3-14b
|
||||||
|
- 14b
|
||||||
|
- reasoning
|
||||||
|
- web3
|
||||||
|
- code
|
||||||
|
- code-instruct
|
||||||
|
- python
|
||||||
|
- javascript
|
||||||
|
- dev-ops
|
||||||
|
- jenkins
|
||||||
|
- terraform
|
||||||
|
- scripting
|
||||||
|
- powershell
|
||||||
|
- azure
|
||||||
|
- aws
|
||||||
|
- gcp
|
||||||
|
- cloud
|
||||||
|
- problem-solving
|
||||||
|
- architect
|
||||||
|
- engineer
|
||||||
|
- developer
|
||||||
|
- creative
|
||||||
|
- analytical
|
||||||
|
- expert
|
||||||
|
- rationality
|
||||||
|
- math
|
||||||
|
- math-reasoning
|
||||||
|
- math-instruct
|
||||||
|
- uncensored
|
||||||
|
- unfiltered
|
||||||
|
- amoral-ai
|
||||||
|
- conversational
|
||||||
|
- chat
|
||||||
|
- instruct
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/sequelbox/Qwen3-14B-Esper3Mix
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen3-14B-Esper3Mix-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ1_M.gguf) | i1-IQ1_M | 3.9 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Qwen3-14B-Esper3Mix-i1-GGUF/resolve/main/Qwen3-14B-Esper3Mix.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0bbf0cadd5963c20650ae5f75fd54db9309c2be2030c9f783eff21f7468b6ec6
|
||||||
|
size 7709765
|
||||||
Reference in New Issue
Block a user