bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-21 17:43:07 +08:00
commit 873dceacb6
28 changed files with 289 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

169
README.md Normal file
View File

@@ -0,0 +1,169 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
base_model: nvidia/Nemotron-Research-Reasoning-Qwen-1.5B
base_model_relation: quantized
license: cc-by-nc-4.0
language:
- en
---
## Llamacpp imatrix Quantizations of Nemotron-Research-Reasoning-Qwen-1.5B by nvidia
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5568">b5568</a> for quantization.
Original model: https://huggingface.co/nvidia/Nemotron-Research-Reasoning-Qwen-1.5B
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<｜begin▁of▁sentence｜>{system_prompt}<｜User｜>{prompt}<｜Assistant｜><｜end▁of▁sentence｜><｜Assistant｜><think>
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [Nemotron-Research-Reasoning-Qwen-1.5B-bf16.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-bf16.gguf) | bf16 | 3.56GB | false | Full BF16 weights. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0.gguf) | Q8_0 | 1.89GB | false | Extremely high quality, generally unneeded but max available quant. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K_L.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K_L.gguf) | Q6_K_L | 1.58GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K.gguf) | Q6_K | 1.46GB | false | Very high quality, near perfect, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_L.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_L.gguf) | Q5_K_L | 1.43GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_M.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_M.gguf) | Q5_K_M | 1.29GB | false | High quality, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_L.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_L.gguf) | Q4_K_L | 1.29GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_S.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_S.gguf) | Q5_K_S | 1.26GB | false | High quality, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_XL.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_XL.gguf) | Q3_K_XL | 1.18GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q4_1.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_1.gguf) | Q4_1 | 1.16GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_M.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_M.gguf) | Q4_K_M | 1.12GB | false | Good quality, default size for most use cases, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_S.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_S.gguf) | Q4_K_S | 1.07GB | false | Slightly lower quality with more space savings, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q4_0.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_0.gguf) | Q4_0 | 1.07GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_NL.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_NL.gguf) | IQ4_NL | 1.07GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_XS.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_XS.gguf) | IQ4_XS | 1.02GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_L.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_L.gguf) | Q3_K_L | 0.98GB | false | Lower quality but usable, good for low RAM availability. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K_L.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K_L.gguf) | Q2_K_L | 0.98GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_M.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_M.gguf) | Q3_K_M | 0.92GB | false | Low quality. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_M.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_M.gguf) | IQ3_M | 0.88GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_S.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_S.gguf) | Q3_K_S | 0.86GB | false | Low quality, not recommended. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XS.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XS.gguf) | IQ3_XS | 0.83GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XXS.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XXS.gguf) | IQ3_XXS | 0.77GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K.gguf) | Q2_K | 0.75GB | false | Very low quality but surprisingly usable. |
| [Nemotron-Research-Reasoning-Qwen-1.5B-IQ2_M.gguf](https://huggingface.co/bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF/blob/main/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ2_M.gguf) | IQ2_M | 0.70GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF --include "nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-GGUF --include "nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a819d9df2b7dd6ed0259f9f123deeef3be59cf7bff96b36fed0f13f7bd69427c
size 701332512

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8902143d75c2fec30af110e7f18fea2221658590d1202d0f35d1248b63d7b220
size 876941856

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9056362199d13a62fa5511622715e84503e7a0f91540a594f40123299f99ddbe
size 831976992

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba36e0ce3bc87ac827f85e2a5e805cf815213c3d71bec6b50836bd174f0675a0
size 769070112

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8f12e93870b09d30c0e6b6727f8303658ee2d1dfff1238c4f07893aff154390
size 1067604000

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9133a2145d2b6c1982d054ea29ff73fc0a311553dd1f08556354332bfcc2aa14
size 1019711520

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c98414ece3304476be25af005794867da977607afd9f61320fbf653b625d9e6
size 752880672

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abda7eabe2dd32642be45c6ebdeaf5d3ae2187a88b4335f5983207829eded935
size 980784672

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79e4587097ea889c41f7c2a939fc6710f2067ef6cf6ebc34d795c0ef564f3b28
size 980440608

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:92b6f2bb5d6fc669490594d61db2c64783e56277d377ee02ad11b89a20d95e13
size 924456480

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f812831681db71a86a6b14b390072152d6377d4c32ccfeb3dda3dc324e965e55
size 861222432

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:93b0de97ea3a3222be7155c2ba35056a8332978c4418f6994b39fb5c81b057b8
size 1184642592

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:191ef1050f752fceebd2184423b2d730a2c15940fc832a8f9275836facfc6c8c
size 1068808224

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b381a601117617560728063a42df588e15ff2d57ae4012641093fb05da469ff
size 1162700832

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d0d259a8f82077f7b72229d55c1e8e91fde712b84e1bc30f0f30b5dbbe65754
size 1290528288

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3685e223b41b39cef92aaa283d9cc943e27208eab942edfd1967059d6a98aa7a
size 1117321248

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca0e061e19c69e5797d5dae03026a784590e175926cf7d80ee210ebcb2b20d9c
size 1071585312

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47147333df49ed959921537ee3b3d1521b5e8895b03e28c4871163f4324bf0c5
size 1429530144

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48477599b6c88cf77e4f30f502122e57b45b26ba302e3f4636fd3a5f8caedc44
size 1285494816

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c3716caabe2022cefbcceface608368f5fbdec4a85a5419cba57651ff8380c8
size 1259173920

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a938f813ed95f4dd5921878695e6a5364a59d36605e11116063a7eccc23c6e57
size 1464179232

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13a63f4794f160fba5ab4f1c1a5a6960a4341eefecb7975b4951ce02082ddd61
size 1577219616

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f92f8b9027aeb8f3a4bcbba662779861132d930024bbf251fb61a5e39f69ff29
size 1894532640

3
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65cda1ac719882c2de128a9630187b5b20b88aab5cedbe2ec48413960326570a
size 3560416480

BIN
nvidia_Nemotron-Research-Reasoning-Qwen-1.5B.imatrix Normal file
View File

Binary file not shown.