mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

Compare commits

base: mradermacher:85daa924fe6a9bbbfd10b0209b95a1f3f3c20217
Branches Tags
mradermacher:main
...
compare: mradermacher:14b89845c5109111ff057db365aa5fa177fae599
Branches Tags
mradermacher:main

10 Commits
85daa924fe ... 14b89845c5

Author SHA1 Message Date
team mradermacher
14b89845c5 auto-patch README.md 2025-12-08 13:34:17 +00:00
team mradermacher
285a9be78b auto-patch README.md 2025-10-21 15:13:37 +00:00
team mradermacher
06aa264c38 uploaded from marco 2025-10-21 15:13:23 +00:00
team mradermacher
f0dae24be9 uploaded from marco 2025-10-21 15:12:59 +00:00
team mradermacher
c9242c8093 uploaded from marco 2025-10-21 15:10:37 +00:00
team mradermacher
39ae9eadf6 uploaded from marco 2025-10-21 15:09:23 +00:00
team mradermacher
f5cee22665 uploaded from marco 2025-10-21 15:07:36 +00:00
team mradermacher
0f144cb58b uploaded from marco 2025-10-21 15:07:08 +00:00
team mradermacher
e403990983 uploaded from marco 2025-10-21 15:05:20 +00:00
team mradermacher
884f324b63 uploaded from marco 2025-10-21 15:01:58 +00:00
10 changed files with 53 additions and 1 deletions
Expand all files Collapse all files

8
.gitattributes vendored
View File

@@ -50,3 +50,11 @@ DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lf
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ddcd06c32a2367b7a334433b973415285c85971d6aea59ab8b38432ebc7fd31
size 2019630976

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20eb6f8f0f2f77a05de5a81962d2374fc62e8611e86483d784c5561f401b61fb
size 2758492032

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7d3c63d0c144c009ba2c069476b8ef7dddfff50f8957bf9f70b3a1a5d92b34e
size 3682328448

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:012acabcb6312d9739e84de9db6996bc2450d5860a5c4222cdddbd1f09a35825
size 3518750592

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:696c751d646b88e0e3e7f9fb22af2636a8002cc113e420c47b5b7c986e40d5f1
size 4675895168

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:def6454ef7999f3b5b59309370223173b5833301bb8eeee76b2354ca26820add
size 5130256256

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72f01fd44b5a9a8ec07c3403be570c595b2ec8e50a337b2ed60e531b1caf2990
size 5732990848

3
DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5062da911bf37ebcf442c7320700da7ab7a193b697430834e044aa936abeb6db
size 5599297408

22
README.md
View File

@@ -38,11 +38,31 @@ more details, including on how to concatenate multi-part files.
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own qwuants) |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/DLER-Llama-Nemotron-8B-Merge-Research-i1-GGUF/resolve/main/DLER-Llama-Nemotron-8B-Merge-Research.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):