mradermacher/GaMS-9B-Instruct-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/GaMS-9B-Instruct-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-05 15:43:18 +08:00
commit e429ffae2a
27 changed files with 215 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
GaMS-9B-Instruct.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
GaMS-9B-Instruct.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da309ff1c45acf02dfeb37b9c22a4e64dac11806680ef45e810272e16fb926a2
size 2545952704

3
GaMS-9B-Instruct.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:948ae59bec0d0f78ee8a2d5e7102a02107a9e322168d42aea52dd34dbeb07286
size 2378565568

3
GaMS-9B-Instruct.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cca06a547e4417187537defa2844af90bf830fc8e7f1821d26c00f64841dfee0
size 3434670016

3
GaMS-9B-Instruct.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44d47a293f2ef667b8f6c4688ecc6f95def20b9b1737752bb5326bb4f43f02ff
size 3211487168

3
GaMS-9B-Instruct.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1570ded7b38e3e90c6d39aad2ae244b925a29cfc2d79edfa73ec62bb4adb684f
size 3067381696

3
GaMS-9B-Instruct.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2803a46435e14fd695b04c3ce068a83c1aef7de28a4ca77587371fc9bf6ff6d3
size 2824931264

3
GaMS-9B-Instruct.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87623a83af1fbf5d95fe61147748b296833c45f8069830be6290515426452fc0
size 4494616512

3
GaMS-9B-Instruct.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7e737d44e8d2bf93700ce8af36c2febc220b80f2cc206dcfb63d97690daa76f
size 4337665984

3
GaMS-9B-Instruct.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6ae8a647c2e3770852c823230a037935373cb08dc0f1c191d093ee007e72957
size 4144990144

3
GaMS-9B-Instruct.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:885e76e3a707a72a1e1286c60c64441ff96113be7b1c0ad3e67ded977bd0449a
size 3796740032

3
GaMS-9B-Instruct.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8a7833700958989afe582fb37ec2be03fce7d14e31c6f02bf5252b9ab0aeb8e
size 5443143616

3
GaMS-9B-Instruct.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81efe325c487b8c078cc4fec62323b0a5b4758cfc1af6a5e860217e51406e482
size 5183031232

3
GaMS-9B-Instruct.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d88fb6dc93019f45f06acbdb721d54bc39c250a7f4a89159029c9e4bf7d3d50a
size 3805398976

3
GaMS-9B-Instruct.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c91db123ba35e28dc3ee913a058b2f6f64677720aef03166fd42397fe8dd1cb
size 3552511936

3
GaMS-9B-Instruct.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a34261c5604feb749853927891e597ad070740493d8c16e5c1177fadec6e0183
size 5132453824

3
GaMS-9B-Instruct.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f54eae6bc4e18e611d086797f0b2dc3f1d98503bfee26a25cc810af52e18454c
size 4761782208

3
GaMS-9B-Instruct.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c93186d8150f1e177c55503938fc1dcf8f8c282853196541b55dba40ffd2745a
size 4337665984

3
GaMS-9B-Instruct.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fcf4c0d2990af5dcd4f691922f3411a87bba0ee08e1f39b99521b0834e14d95
size 5459199936

3
GaMS-9B-Instruct.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47575a5e36c3dfb5ee56a7a5bcb47089fc5daade50cf57fdb15c5482f18b7ab8
size 5963368384

3
GaMS-9B-Instruct.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ebb226c4f9392d5ce89e049b40dab936ffb56fb38aebc8b60528ab21bcb71e9
size 5761058752

3
GaMS-9B-Instruct.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5b028fe6c9f3150a8a2cb236e9dc8407938af7ce7751312c5053a0ec0628870
size 5478926272

3
GaMS-9B-Instruct.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80c3035dff5b68f9d96aa90e2ebaf6b625d12fa062a19c68644d92e4837e78af
size 6647367616

3
GaMS-9B-Instruct.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf542b6b2cca54be011ae111c133f4b64fcd60ef7238dd53f14e8296e140f0e6
size 6483593152

3
GaMS-9B-Instruct.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f305ad4afab4e8566702b012d9cac625195bc68fb2c28a3f4057d054db0bce5
size 7589070784

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: cjvt/GaMS-9B-Instruct
language:
- sl
- en
- hr
- sr
- bs
library_name: transformers
license: gemma
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/cjvt/GaMS-9B-Instruct
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/GaMS-9B-Instruct-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-IQ4_NL.gguf) | i1-IQ4_NL | 5.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q4_1.gguf) | i1-Q4_1 | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/GaMS-9B-Instruct-i1-GGUF/resolve/main/GaMS-9B-Instruct.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01b9ea78177b9af57234f0170bbd89cd87990ffe4a57d8e1e7d4413bf5bbbc71
size 6116887