mradermacher/SmolTulu-1.7b-RM-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SmolTulu-1.7b-RM-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-06 02:19:17 +08:00
commit a7ddb7d1a0
25 changed files with 214 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SmolTulu-1.7b-RM.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: SultanR/SmolTulu-1.7b-RM
datasets:
- allenai/llama-3.1-tulu-3-8b-preference-mixture
language:
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- Tulu3
- Smollm
- SLMs
- Small
- Huggingface
- Allenai
- Reward Model
- RLVR
- RM
- Reward
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/SultanR/SmolTulu-1.7b-RM
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q4_0.gguf) | i1-Q4_0 | 1.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/SmolTulu-1.7b-RM-i1-GGUF/resolve/main/SmolTulu-1.7b-RM.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SmolTulu-1.7b-RM.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7f5b4cb2e870a0341265ca5671b07724993ebbc3edb504b7e85edbf0fc398ca
size 444171680

3
SmolTulu-1.7b-RM.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9f8f5647b1da034792b6705beeabb8cfea835dc8524c609e52610844ae5f74e
size 412321184

3
SmolTulu-1.7b-RM.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:992855dc03bc49b799b49dc9c57994332732f2fb4419dd6c41e89883eea6d00c
size 614827424

3
SmolTulu-1.7b-RM.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a53eb54496057176e4093d8630e2890541590833a92f0d5676001549f2d62c24
size 572360096

3
SmolTulu-1.7b-RM.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e9df66dd730a078bbe58756d59b333573e6e35fd7077eca0d5d974547f805cc
size 542868896

3
SmolTulu-1.7b-RM.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab98a9c2456ad1b873ec19d5b8256af7e7e7a0d4b4f828b24886e3894d63faf4
size 497255840

3
SmolTulu-1.7b-RM.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b891bfbbad3b45d5a460e7ea5979c5b4f27e6d566fe0f6555b70258b40063c9
size 810257952

3
SmolTulu-1.7b-RM.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c805c60fdaea2ebb601fff8bf2af3fd0e2659d2ac168cfac81263e5ef40f9d7a
size 776834592

3
SmolTulu-1.7b-RM.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d356230672150e1fbfd00efa94dc3a2c91a450be1a604958c8ea7d1aa0f7a970
size 739085856

3
SmolTulu-1.7b-RM.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a7ff05fb9a9c533ff69bc42c90e82eaa482e917411b0e547f5bce65ff438118
size 680101280

3
SmolTulu-1.7b-RM.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63efe55bbef52e367a7fa1a77bec1be842f3ea1b41db2e9e110bc3d40a851817
size 940412448

3
SmolTulu-1.7b-RM.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7d35c6f75cd06f1552ddca14d1f81523d7b8e4ec64c2523491ed545bd24dae4
size 674598432

3
SmolTulu-1.7b-RM.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37e8a847d721707626b1678dec4adf4ab49b1df13c67f4ab2a7233a91cae1629
size 625053216

3
SmolTulu-1.7b-RM.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e47364cf5a9a748a4fbbdd31fcd1c800778578725888797ebe1b409c532ebf0
size 932548128

3
SmolTulu-1.7b-RM.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b20106ab3eaabfcc7205a0280472f9f69db38591962296e8e912c7d197bbd6e1
size 860196384

3
SmolTulu-1.7b-RM.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b42bb97a2d75e34bc85fe984eca5f77b4c477f2de5ea5c0ad3a8cb553b5f6ce8
size 776834592

3
SmolTulu-1.7b-RM.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42b7c57952cb2e07db3d6225dabfacd600dc8fb7e324815bf5dcdf12bdfa2331
size 993889824

3
SmolTulu-1.7b-RM.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26ce3ebc73078741cd735057f5340e73a2bb37b0e20f1a136a5fbc2849ed3ea1
size 1055624736

3
SmolTulu-1.7b-RM.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f87b46a84c9971de34ee514dfd5a738ed1954ee8d743454fff4f979621e7b24
size 999132704

3
SmolTulu-1.7b-RM.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0ab86063afc0be2822b6a3b872af5faa7783db04e05ef64fe344a484e29acf5
size 1225494048

3
SmolTulu-1.7b-RM.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb3c12228dce098513a9ac119337ca4b6d364591b002ce445fa2629de0a28eef
size 1192070688

3
SmolTulu-1.7b-RM.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a014d4ff551197a7013c6cccfd622d22452b6cd53cb1c1229a77a6b44118b54
size 1405980192

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bee04545023b3c76ada328a372d6ee3a4a01c9c2b10f2e5aaa5c8873b102e5d7
size 1971637