mradermacher/GRM-Coder-14b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GRM-Coder-14b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-05 17:18:16 +08:00
commit a03aad0163
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GRM-Coder-14b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
GRM-Coder-14b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fbc10525097516d8b6241e57b77d6146f989911fb5cd1db0ddf8c33c3149fda
size 3849657024

3
GRM-Coder-14b.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab1112a7d03392c6448d073c7f98f6a0d7cabc7af163915b6ef14040fd047622
size 3579935424

3
GRM-Coder-14b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c0c29e2432f46391ec8de3e577ef46924d908fff9a3cda2fb6fff12f1f8dfec
size 5322942144

3
GRM-Coder-14b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb61069e2dbe485230ce88200902818d3709d37c20d96e9c6730ab51ae58b9af
size 4963313344

3
GRM-Coder-14b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d5442f28eef2b52ca3c0c591bb2ede3e32bb1c2c124f199fa4c6f9621635d4f
size 4691589824

3
GRM-Coder-14b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d87a40bcd92d0f56e3e53ae259f7eb1d1e30762849b20b59990cd5cdcfd6d5e2
size 4299193024

3
GRM-Coder-14b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e4dd8ee0f97988d933730edf537119ccbc828d464f00482beab573e88c6f521
size 6883410624

3
GRM-Coder-14b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7431280af60fe0538d50280286e97106349b6a3cc5118757a2c63dd7d3594c7
size 6684959424

3
GRM-Coder-14b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da07f21d6e369f9af23d778f88198cde567ead489fd87b92d1b446e28f6ed7a4
size 6375301824

3
GRM-Coder-14b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00a23e34036a9d5cb0827602f243908be6b2c7eaf78b67e44a075050d9319498
size 5942666944

3
GRM-Coder-14b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0ef202e367b9c7fc6fd527e20c50e5677445a9b68ae652cb74a3fef03a8e632
size 8541363904

3
GRM-Coder-14b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9a9bfc9eeabca47e3203238977c4ed69ee502f30d5d1797533b8e2792cffab6
size 8110730944

3
GRM-Coder-14b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:103c6943d884666dd33b14e0b6715b7553472935936d097e0ffc6125354cd048
size 5753984704

3
GRM-Coder-14b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e1c81f6b20d7f1448aef72632d12f8655b11697ca495daca2dacc53e860b6c3
size 5389850304

3
GRM-Coder-14b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7b35214b2b0bb03ca7039900ef5372227eeea73cfbcbafd757fbca488e2ad19
size 7900652224

3
GRM-Coder-14b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9db9792814330394414f45b1fbbcedf37b96cffb27fd93d528467aa86cb25237
size 7321313984

3
GRM-Coder-14b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0faf3989d56ac132c5426ede0dc978cb0bdb4952c74b890062d3ad42f6cc00b
size 6657106624

3
GRM-Coder-14b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f67ced65b837eec0bed41b5b2504f2f4ca64799e8eb9c55f01898b2a8a71795a
size 8543002304

3
GRM-Coder-14b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a974c2d585b6027f57128c33ff62fce430cc2ae837b27578de4f8ccc7e805a6
size 9389522624

3
GRM-Coder-14b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12755c8c0a87fc17c16d78d2ed569c7e71edeb79dc42555013450197a8f510f0
size 9001754304

3
GRM-Coder-14b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3aa7bd067acbd799b89c407e961d9a00b5d3f5c8c889aed55ada016dcb973bc
size 8573476544

3
GRM-Coder-14b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4b12d6e9f4765348f6cfbaf05e74c9f9d2d67c38c1099d6280ab96ec225e676
size 10514570944

3
GRM-Coder-14b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c92dc39c3316fe2cdceb185a789638f6821975f188fd340bebacb311bdbaf09
size 10263895744

3
GRM-Coder-14b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f68facb5271c9b38af5158fc9d8e0c149cd901db980e959032c86c12df9be446
size 12121938624

3
GRM-Coder-14b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2f360722d4ede7d0aa5f7c9cc2ffe0e89d99f660590cbae163e2b6fee00d5d7
size 7743552

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: OrionLLM/GRM-Coder-14b
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- qwen3
- code
- text-generation
- safetensors
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/OrionLLM/GRM-Coder-14b
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GRM-Coder-14b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/GRM-Coder-14b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ1_S.gguf) | i1-IQ1_S | 3.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ1_M.gguf) | i1-IQ1_M | 3.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.8 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ2_S.gguf) | i1-IQ2_S | 5.1 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q2_K.gguf) | i1-Q2_K | 5.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ3_S.gguf) | i1-IQ3_S | 6.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 8.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 8.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q4_0.gguf) | i1-Q4_0 | 8.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q4_1.gguf) | i1-Q4_1 | 9.5 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/GRM-Coder-14b-i1-GGUF/resolve/main/GRM-Coder-14b.i1-Q6_K.gguf) | i1-Q6_K | 12.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->