bartowski/nvidia_AceReason-Nemotron-14B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/nvidia_AceReason-Nemotron-14B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-29 22:35:14 +08:00
commit 28b56bd58b
30 changed files with 308 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

179
README.md Normal file
View File

@@ -0,0 +1,179 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
language:
- en
tags:
- nvidia
- reasoning
- math
- code
- reinforcement learning
license_name: nvidia-open-model-license
license_link: https://www.nvidia.com/en-us/agreements/enterprise-software/nvidia-open-model-license/
base_model: nvidia/AceReason-Nemotron-14B
base_model_relation: quantized
license: other
---
## Llamacpp imatrix Quantizations of AceReason-Nemotron-14B by nvidia
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5432">b5432</a> for quantization.
Original model: https://huggingface.co/nvidia/AceReason-Nemotron-14B
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<｜begin▁of▁sentence｜>{system_prompt}<｜User｜>{prompt}<｜Assistant｜><｜end▁of▁sentence｜><｜Assistant｜><think>
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [AceReason-Nemotron-14B-bf16.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-bf16.gguf) | bf16 | 29.55GB | false | Full BF16 weights. |
| [AceReason-Nemotron-14B-Q8_0.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q8_0.gguf) | Q8_0 | 15.70GB | false | Extremely high quality, generally unneeded but max available quant. |
| [AceReason-Nemotron-14B-Q6_K_L.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q6_K_L.gguf) | Q6_K_L | 12.50GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [AceReason-Nemotron-14B-Q6_K.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q6_K.gguf) | Q6_K | 12.12GB | false | Very high quality, near perfect, *recommended*. |
| [AceReason-Nemotron-14B-Q5_K_L.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q5_K_L.gguf) | Q5_K_L | 10.99GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [AceReason-Nemotron-14B-Q5_K_M.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q5_K_M.gguf) | Q5_K_M | 10.51GB | false | High quality, *recommended*. |
| [AceReason-Nemotron-14B-Q5_K_S.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q5_K_S.gguf) | Q5_K_S | 10.27GB | false | High quality, *recommended*. |
| [AceReason-Nemotron-14B-Q4_K_L.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q4_K_L.gguf) | Q4_K_L | 9.57GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [AceReason-Nemotron-14B-Q4_1.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q4_1.gguf) | Q4_1 | 9.39GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [AceReason-Nemotron-14B-Q4_K_M.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q4_K_M.gguf) | Q4_K_M | 8.99GB | false | Good quality, default size for most use cases, *recommended*. |
| [AceReason-Nemotron-14B-Q3_K_XL.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q3_K_XL.gguf) | Q3_K_XL | 8.61GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [AceReason-Nemotron-14B-Q4_K_S.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q4_K_S.gguf) | Q4_K_S | 8.57GB | false | Slightly lower quality with more space savings, *recommended*. |
| [AceReason-Nemotron-14B-IQ4_NL.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ4_NL.gguf) | IQ4_NL | 8.55GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [AceReason-Nemotron-14B-Q4_0.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q4_0.gguf) | Q4_0 | 8.54GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [AceReason-Nemotron-14B-IQ4_XS.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ4_XS.gguf) | IQ4_XS | 8.12GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [AceReason-Nemotron-14B-Q3_K_L.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q3_K_L.gguf) | Q3_K_L | 7.92GB | false | Lower quality but usable, good for low RAM availability. |
| [AceReason-Nemotron-14B-Q3_K_M.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q3_K_M.gguf) | Q3_K_M | 7.34GB | false | Low quality. |
| [AceReason-Nemotron-14B-IQ3_M.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ3_M.gguf) | IQ3_M | 6.92GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [AceReason-Nemotron-14B-Q3_K_S.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q3_K_S.gguf) | Q3_K_S | 6.66GB | false | Low quality, not recommended. |
| [AceReason-Nemotron-14B-Q2_K_L.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q2_K_L.gguf) | Q2_K_L | 6.53GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [AceReason-Nemotron-14B-IQ3_XS.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ3_XS.gguf) | IQ3_XS | 6.38GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [AceReason-Nemotron-14B-IQ3_XXS.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ3_XXS.gguf) | IQ3_XXS | 5.95GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [AceReason-Nemotron-14B-Q2_K.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-Q2_K.gguf) | Q2_K | 5.77GB | false | Very low quality but surprisingly usable. |
| [AceReason-Nemotron-14B-IQ2_M.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ2_M.gguf) | IQ2_M | 5.36GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
| [AceReason-Nemotron-14B-IQ2_S.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ2_S.gguf) | IQ2_S | 5.00GB | false | Low quality, uses SOTA techniques to be usable. |
| [AceReason-Nemotron-14B-IQ2_XS.gguf](https://huggingface.co/bartowski/nvidia_AceReason-Nemotron-14B-GGUF/blob/main/nvidia_AceReason-Nemotron-14B-IQ2_XS.gguf) | IQ2_XS | 4.70GB | false | Low quality, uses SOTA techniques to be usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/nvidia_AceReason-Nemotron-14B-GGUF --include "nvidia_AceReason-Nemotron-14B-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/nvidia_AceReason-Nemotron-14B-GGUF --include "nvidia_AceReason-Nemotron-14B-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (nvidia_AceReason-Nemotron-14B-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
nvidia_AceReason-Nemotron-14B-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e409f62566d6edcd500aa7d603d42661aa275b0fba92dd86c31f8e2973077ac
size 5356146080

3
nvidia_AceReason-Nemotron-14B-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e56dde89181cf92df26ba8a9223d4aa0cd46ef4c0dc6f5be98e9e20c19dfb569
size 5003726240

3
nvidia_AceReason-Nemotron-14B-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31b43ad666511f596b60a43a1f993254aec8346967b6b6e7f2cd7c1e8e4cb222
size 4704574880

3
nvidia_AceReason-Nemotron-14B-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6774523b539ef80bbb7aacd70dc5ff82f46cbf2bd370faecfb0e728d57849277
size 6916537760

3
nvidia_AceReason-Nemotron-14B-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9a3aabfa58fc488b391d2723a4b9d09e2d9690bae179100c7d3a71d47c48445
size 6383361440

3
nvidia_AceReason-Nemotron-14B-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14ba987975690beb539b5aa93ef19b2a8c36625e3ed930eb803132412ae72219
size 5946707360

3
nvidia_AceReason-Nemotron-14B-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34336ee1a1ca84db4b83862efff18428b114eb467066b2c69091dc0dd244713c
size 8549182880

3
nvidia_AceReason-Nemotron-14B-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bf6ad61855fef646032a9b71cd98c017279d20204ecbcde66464ca6b5763e49
size 8119840160

3
nvidia_AceReason-Nemotron-14B-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ed47922d98eab25002cbb6ae52d9a87d7d8deb6d35d571d41e452e9a27f7320
size 5770497440

3
nvidia_AceReason-Nemotron-14B-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89975dc468738d83aecfc8e9cbcbe61aabcaa23884eb120cf292e7eff7bf9216
size 6530817440

3
nvidia_AceReason-Nemotron-14B-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c546292bc4e13f8a6067eea8633f2193e9ef8a5d7661b8e713bbbeb5f28c129e
size 7924768160

3
nvidia_AceReason-Nemotron-14B-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64b131a1ba57e6b4409996c50d6e6d89ca5e9faf498b2af60dbf53757fa4c373
size 7339204000

3
nvidia_AceReason-Nemotron-14B-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9ecec43f5b573da6e18c672dd39610fabd70525a1f1318bbf78183b9870916a
size 6659595680

3
nvidia_AceReason-Nemotron-14B-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff3cf70781b054b2c9b76e51721253f9e7fb02d18995f041fb9d789f8bb8960f
size 8606014880

3
nvidia_AceReason-Nemotron-14B-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ae1626d12451e996afcda9d26b8c6579a36c55e31704fb15c0e88f5eb8f61c2
size 8544267680

3
nvidia_AceReason-Nemotron-14B-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d74d0f25ac600d0b0b74a02e898fcf264901ae8da6da251013b12fcd1bf8db33
size 9392139680

3
nvidia_AceReason-Nemotron-14B-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ef03ea9c4c8161d65296b49f9c700a25b6b6fcdd89eecc70d9ac70f00f2a659
size 9565953440

3
nvidia_AceReason-Nemotron-14B-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf78ee6667778d2d04d996567df96e7b6d29755f221e3d9903a4803500fcfe24
size 8988110240

3
nvidia_AceReason-Nemotron-14B-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0833e05e8e22e29f868e1680ce4418a20fb0244b6c46d079c3a2424feec6c9f
size 8573431200

3
nvidia_AceReason-Nemotron-14B-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:255e67453e70500a59752d4c60822e3750499ea335bd61801ae43782824a488c
size 10989395360

3
nvidia_AceReason-Nemotron-14B-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:88fa3fd38368e4a2af3ff735f14d50ca9be03bb09367431f6d68876349d494d2
size 10508873120

3
nvidia_AceReason-Nemotron-14B-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c504e3a56801c6f02c6d338031e45284423bdd52eb7c443b586526c7e6a7fcbc
size 10266553760

3
nvidia_AceReason-Nemotron-14B-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:351c7bfdbcb199805e62e740d1df6f2449a1770435abc04b8ab6e12d4b4b7ca3
size 12124683680

3
nvidia_AceReason-Nemotron-14B-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7be36590e67c82f44c491a9a62946da7839c82198317dd31505553e674221777
size 12501802400

3
nvidia_AceReason-Nemotron-14B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e94ed4adbc675995976fe0fa013d782a7be673a9f41c7d5603d895eb322b85e2
size 15701597600

3
nvidia_AceReason-Nemotron-14B-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf6f0f1ad9f406e36c452b1107dfe045453c9f2828eaf8a3746090fded71646c
size 29547715712

3
nvidia_AceReason-Nemotron-14B.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9662e511cc258502a693d4790a808f090b2a715e3ed1bd4010c8e8ecdfaf614e
size 8563610