mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 01:15:21 +08:00
commit b2561ff903
27 changed files with 224 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct-Nemotron.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
GaMS-9B-Instruct-Nemotron.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21c813c7d2daaaf3995fbe2b5aa23c5a1ca7e81632e0a6461784cd7349971744
size 2545953088

3
GaMS-9B-Instruct-Nemotron.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98f906dfba250ab6c66099c4d137f534ec5a53bae052e06fd7d5379b0aec7ddc
size 2378565952

3
GaMS-9B-Instruct-Nemotron.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c80c0623bce3084bd274a53711dac53e9f6175a5307e516d55b8c79e9e8aeb6b
size 3434670400

3
GaMS-9B-Instruct-Nemotron.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:793143a996574c2269144ed5dc2603a9fe23ca8cca1fd2ad3e0f34ed5c69b6f2
size 3211487552

3
GaMS-9B-Instruct-Nemotron.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ffc61e66aec42ef91ac7513af245af9a52b0ed92fc7aa1bce01709728c06175a
size 3067382080

3
GaMS-9B-Instruct-Nemotron.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abb48724791907972231a3db463b22f316b18a31937d9182307aa1b6fc339624
size 2824931648

3
GaMS-9B-Instruct-Nemotron.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68463429f30820d63721189b11767bd1d0ad3cf0218725904f9a8a39a4e57aad
size 4494616896

3
GaMS-9B-Instruct-Nemotron.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ff27b63574a5faee859f3f804be67c8fdeb223c367a92492f59f580e980f3ef
size 4337666368

3
GaMS-9B-Instruct-Nemotron.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b0bd7e8976a367f9293f94a7ae5f27c9acbd595a76859d0633fa165523bb348
size 4144990528

3
GaMS-9B-Instruct-Nemotron.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fe938f4225916a048a7f1234b8cc4f7f7a9f7c8cb365c3043ea81de6ba655cb
size 3796740416

3
GaMS-9B-Instruct-Nemotron.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:550dd5809ff5eabebd119fac226259f67056dbbfe8a59b9d21d62b7bc492c7db
size 5443144000

3
GaMS-9B-Instruct-Nemotron.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:693d8b8dadbbf498d13e1eab55e332c1a14c1cccb849aad655f1d21b976a9403
size 5183031616

3
GaMS-9B-Instruct-Nemotron.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f41562e978d3bbbac23720c8aff9a464c54e7f79bb9af6510881ab28a73733c1
size 3805399360

3
GaMS-9B-Instruct-Nemotron.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee14ff92e275896c5e2b2aac90a3683dd34291342bad5f446dbae8d88e3956ec
size 3552512320

3
GaMS-9B-Instruct-Nemotron.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56dbd89409a6dec0a3706804e8f064c7b3ca66fb26e227c856fd9b6704524fe8
size 5132454208

3
GaMS-9B-Instruct-Nemotron.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e38daad0558a13333e3c4dc3d863298f24f544528729f100288b6bfb22bf2acc
size 4761782592

3
GaMS-9B-Instruct-Nemotron.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d35d9bd59af16dfbd99938251d736db089262a801105933243ccace51c021f6d
size 4337666368

3
GaMS-9B-Instruct-Nemotron.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dedc680f57037bc5016cd4eee3f10b9c4288491afb680f6eb8812e076bfa0018
size 5459200320

3
GaMS-9B-Instruct-Nemotron.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:904a1232549feccc7ede7222d0702167f4b5bff0bf9d455383080ce2427ff5d5
size 5963368768

3
GaMS-9B-Instruct-Nemotron.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69088c74d4918d76620baae8520d97621223438c412b30209bf1f794d9679317
size 5761059136

3
GaMS-9B-Instruct-Nemotron.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a076dac2e44b66d99bb54ac5c1bfc8a867ed9376ab6b3526c83aa67e6522ba19
size 5478926656

3
GaMS-9B-Instruct-Nemotron.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:623c193ab68b102e7b34b5293cd565ce0c49448e94558c5f4cbafc6065b402b1
size 6647368000

3
GaMS-9B-Instruct-Nemotron.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a61b5d1adf7e39608b3b86dd3d96fe8cf75a7f66a448c6cb4ae55e0005e96862
size 6483593536

3
GaMS-9B-Instruct-Nemotron.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1bbc8ccc282abd711f345e680658468ae583506c8d003801641d1857a0783afc
size 7589071168

3
GaMS-9B-Instruct-Nemotron.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6974db9266070c5112d85ac32d5b7c48b65feb9f4f1b0c0c98078096a67f72c8
size 6152352

89
README.md Normal file
View File

@@ -0,0 +1,89 @@
---
base_model: cjvt/GaMS-9B-Instruct-Nemotron
datasets:
- nvidia/Nemotron-Post-Training-Dataset-v1
- cjvt/GaMS-Nemotron-Chat
language:
- sl
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/cjvt/GaMS-9B-Instruct-Nemotron
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#GaMS-9B-Instruct-Nemotron-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q4_1.gguf) | i1-Q4_1 | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-Nemotron-i1-GGUF/resolve/main/GaMS-9B-Instruct-Nemotron.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->