mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-27 01:21:19 +08:00
commit ceeeae7f58
24 changed files with 200 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SILMA-9B-Instruct-v1.0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: silma-ai/SILMA-9B-Instruct-v1.0
extra_gated_button_content: Acknowledge license
language:
- ar
- en
library_name: transformers
license: gemma
quantized_by: mradermacher
tags:
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/silma-ai/SILMA-9B-Instruct-v1.0
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/SILMA-9B-Instruct-v1.0-i1-GGUF/resolve/main/SILMA-9B-Instruct-v1.0.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SILMA-9B-Instruct-v1.0.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6dce7cb31dbfc58dc8ab970190276751c677427aaa26e38f75a9326966be854c
size 2545952384

3
SILMA-9B-Instruct-v1.0.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3a04186b3ed770dabf7f51eb2abcc5cfcd2c52dd8cfa22d2f4afcf2b24b4de60
size 2378565248

3
SILMA-9B-Instruct-v1.0.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02b2b07c7038dcc9c91b0121a404dfc74721483e8a9070f82e21e0b78cdd6135
size 3434669696

3
SILMA-9B-Instruct-v1.0.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f96a499a2d281c13c13b23a81c5cbe201bf0d1aa7a5b512b1d0c9f311a9026dc
size 3211486848

3
SILMA-9B-Instruct-v1.0.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:338fdb581783fbb8ecfd4c350ae4ecb9b5061e2d8e1562f3ef0b6f46d48893a9
size 3067381376

3
SILMA-9B-Instruct-v1.0.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea56876b136f8540b508eaaedb35228d2da9d1f5baf85312300b88a3de95fc86
size 2824930944

3
SILMA-9B-Instruct-v1.0.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:349a1e4958a80f2564b10690aa3f72f444622cdae78be8b7d9af77f620b60d02
size 4494616192

3
SILMA-9B-Instruct-v1.0.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7728ffd87649b480a6a28829d27b04d948bedc8e67aacdd9e8017f97279bcdc1
size 4337665664

3
SILMA-9B-Instruct-v1.0.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:096ed9adadbaaa2c771f76b89234062ff1c1a6b3d52479b4a043a178fe5051c5
size 4144989824

3
SILMA-9B-Instruct-v1.0.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4d8017f93ea1f89b97ac9c561c7021b818139367c3bf8f35f54cd2c0dac41d9
size 3796739712

3
SILMA-9B-Instruct-v1.0.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abdd52ee61135e97630a6796c3a311c4543b74d5a82e71e8ca3677b9a9fba934
size 5183030912

3
SILMA-9B-Instruct-v1.0.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94413b9faae721e489ab5f5f83b0ecdaa6c7897d5276cc967d6730fb65c8dea0
size 3805398656

3
SILMA-9B-Instruct-v1.0.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b3483b3f430574ab057eb6cc0691ff19868659f412887a53e06e48543a45c28a
size 5132453504

3
SILMA-9B-Instruct-v1.0.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:682c1c9ebafe147d05d99a3d3ab27d3dfe04a920afd359450a8cd155650ea827
size 4761781888

3
SILMA-9B-Instruct-v1.0.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:282a9b5b410d977e84b72b4382963285985ba39756145524590c16f68c3f9a09
size 4337665664

3
SILMA-9B-Instruct-v1.0.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:06741244f9929ae3691cab42084b3af638f872fd726e04eb0082904d404d41ab
size 5459199616

3
SILMA-9B-Instruct-v1.0.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e9ea13a31bd8eb334f1cff13dec3177fc61b3f2de0c2a2439e1c0c74af91958c
size 5761058432

3
SILMA-9B-Instruct-v1.0.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6d845042a1d74c422ec260449daee6d04000a750d79a125126bb84b02dc79f71
size 5478925952

3
SILMA-9B-Instruct-v1.0.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ad31f5709cec9292a435271408ee1eda3cadd7d93a28eaffe664a6b7616f871
size 6647367296

3
SILMA-9B-Instruct-v1.0.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7fcf24b3137c86b534bde0c998af9990929be7a640b763f8c5587e774f86ca4
size 6483592832

3
SILMA-9B-Instruct-v1.0.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e318ed3dd79f431829aa77c4c7f2df42dee53170aad1fb6a69f7845ebd68e421
size 7589070464

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:788d7bc95ac550d47d753f0fe753b3cf2bdac5a14a7a38f6147261b5b0cc1522
size 6116887