mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-18 05:50:16 +08:00
commit e4cde44af0
27 changed files with 215 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64a4489cb00adcae4821ca6f162d85d30f5073edc953385df1451dc02a66fde3
size 3872309344

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c181f7aa7e542e3ff6853ea64d12b0af46b01ef871d0e7dc1fe2c2d9aa13a543
size 3607994464

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21704dc43dcc3a33983997e9d7114607e847bd05db46b6c7278c4cbfd5fe00de
size 5356146784

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75ac70483a839e2722d659942c96e5c10a066b252defcf9ab435875639e8fc9f
size 5003726944

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0be993c48b840ee617a61d7e4bfd516bcbd977df054a3e3d4eb0f23bb6119c6
size 4704575584

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01f70ccc6fe187e9b572de64655fb7457a62cc4fe02515f76c9650fe5eb0ca44
size 4312834144

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0dd9359c926c5c051e9c8ed23b4b53cbe6d238fcb244dbe88b20731289582da8
size 6916538464

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab9c6d12e98bed2f1999d6d070cdf09683a96b27d460afbe4c2c3c3b7404981f
size 6693019744

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1467f53fe27d658e0f5d0fc9f5ced16fa677d715705250d191129a2bdee1fa9a
size 6383362144

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02e24a2d5af17d00099d3d7296575fee1fcbea28d32e9ec4cdd46158bedbf6c3
size 5946708064

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4a5375931f5f7f5fb523db2b38ad3aab2099613aaf912d2bbf9a2663c674ada
size 8549183584

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c71c42b1e54b2821034f109e551c063e265e5b8663748a17d39cf7fb744ab39
size 8119840864

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cddbbb5a223a2f8a970214b63746eb551e96ca591d60c99c780747cb83091c3
size 5770498144

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f5f1457d0b1ccb8d0aec931f3efa0259b1b2c3b440ee7f2543f21fe1abc1cf1
size 5397188704

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e51e8189eb308604faa6c7efe8bbda6ee16a1681686322f9a552d657432ae55d
size 7924768864

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:537a1ba086a944dfc2593d80ca4e821e36f1bf7a9c76a0a7fe8856826b0672b6
size 7339204704

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:373e4ceac10973735eb8312d4fdfeadcf93fddffb50edda7a19e3d437e5150d2
size 6659596384

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e051ca78c5c5545e8ba9654640e58f9519d65261cd30168482fc7be75761d0b9
size 8544268384

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9aa12f62853b0600963c0f93138d4649322a0fc2a3b30dee8b6b9831891afb6a
size 9392140384

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0010dd23cb0ae8e1b42429f5893759957982254fdaca8b4960b81dfe34ed78eb
size 8988110944

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75a82143f6edccb08a93ec7ca8bc41a2fac886769a10549b47b0cd3b8635332a
size 8573431904

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:887403e6accf59b33fb2582dbbfb52d3683d1d889d8c2ab6462850396f62ff34
size 10508873824

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f814544b2b2a60ede7d671d5c7923100c32add1d093befd4b4c4131c72b83515
size 10266554464

3
CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4792e964d28fa155c1a7c11bd267555b01f1dd4919ffa367add121d6e6fe0e1c
size 12124684384

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: m-a-p/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/m-a-p/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ1_M.gguf) | i1-IQ1_M | 4.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ2_M.gguf) | i1-IQ2_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL-i1-GGUF/resolve/main/CriticLeanGPT-Qwen2.5-14B-Instruct-SFT-RL.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cd30a99a014e6c99eac06db5acd447278764e4d3e8f50baf72609fb28f49ac1
size 8563597