mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-04 09:57:16 +08:00
commit d7b0b4852f
27 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:288e2be4e25f2ea981f3083e3ad2b4e6ce4ce1bd60ecfd4cf0e30e6672397fed
size 2042196864

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:74f4ceba49f8e20c4bc3edf455a49bf782a96d98d5d9328b7892c474d427da48
size 1903668096

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:423bd349339d5d3343add98f64a862d8a35e8438e80270bea03c31b902c7b4d5
size 2780343168

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86838470b6cc7c18a16cf1d34b348210079801c6a170789ba75cb9f6ce8e91aa
size 2595638144

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3c0006f5b77e3f56ed001394a7518ef7bcb9b0bdcb216d664fba37aee781308
size 2469022592

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32182107c4565b071140e146861d2c544ca913f99f572dff4bd4c094f14b6d0b
size 2273078144

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b21c7a2f8dc6961bd5a0641db6ce7da530f39ee1c5ac888bb6dd3c2047ce6712
size 3574012800

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4b365945dd8be124d154a7b06d5b8253be715b36e17cd046f20f4c4f9fa67dd
size 3499193216

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d9b8c67c533663c7672532519836bb80afb02d54fc8de3e4687b3c8c37c0857
size 3346256768

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84a0e073630c7146d3009bec649ee78164c773585eebf863e77bacade9d1666b
size 3114515328

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffa87a01a30e5d3a6841479ccb4cd41c6a5324cbf9dd32beb0642e785a588406
size 4437814144

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1453af420f26ea4a5a74249ed0e9f1021e19894d79a704e91ed3db0b5fc062e6
size 4218473344

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0dd989860427ca21a8712a6733e2ec2cc90b9faeab7860816f4c8e22ac7489b
size 3015940992

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e206945bbdcab0552728eee9d957b9398508c7727c6f5517580cc5d25aa785e
size 2834074496

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb347da55b8790a3076e417181bccb3f2d8017a114abf490ea23c47bc5a5b60f
size 4088460160

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:550ab5d07ea1f047fd9841e37c5cec2164aaecba37d5d2a08f6b237f4bf6b851
size 3808392064

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c18d9ae04279f761c9fdaca781aaec2fc05d2da84ee1fa32a1927e16e2c84dc
size 3492369280

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88fe67baae23512526fe302cc71943a87134f2843d74391ffe675901c543fbb8
size 4444121984

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:130189de48c510bfe0852186d27487df03ec236a517c33e298ec75fc11f314cf
size 4873284480

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a63ec23b3146522530959d21f0d42f9c73461c6bc4a40e41a14eb16d505040c
size 4683074432

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5271f3474827bbe4df8af67ea0006491457ff3048238483161ef9beee514954
size 4457769856

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0941fca9989550e9c3fe739868d26d120edb569582b496343d3caaeda9826af1
size 5444832128

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77d58225c1a3bfd20c9ee239eb6fd6db2fc47cb9f2551e7c9498ceb915ec0f9f
size 5315177344

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65cb2ee324b7bd9a9329a4646cd7c1ad6dcf773cd7580e81b5d70bbabf1362df
size 6254199680

3
AceReason-Nemotron-1.1-Off-policy-GRPO-7B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc5b9306d3249b2a7e6cd7682a2eb469e4fb4692ebb20a84b71860b9ee20ea32
size 4560352

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: KRAFTON/AceReason-Nemotron-1.1-Offline-GRPO-7B
language:
- en
library_name: transformers
license: other
license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
license_name: nvidia-open-model-license
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/KRAFTON/AceReason-Nemotron-1.1-Offline-GRPO-7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/AceReason-Nemotron-1.1-Off-policy-GRPO-7B-i1-GGUF/resolve/main/AceReason-Nemotron-1.1-Off-policy-GRPO-7B.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->