mradermacher/SakaRP-1-1.5B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SakaRP-1-1.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-30 22:05:21 +08:00
commit 50dcc0c8d0
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SakaRP-1-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Sakalti/SakaRP-1-1.5B
language:
- en
- ja
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- qwen2
- trl
- sft
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Sakalti/SakaRP-1-1.5B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/SakaRP-1-1.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/SakaRP-1-1.5B-i1-GGUF/resolve/main/SakaRP-1-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SakaRP-1-1.5B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58b05f44ed8a15ba34efc63e718f20b4db7437ae0c7a87054031317e9fc99415
size 464461920

3
SakaRP-1-1.5B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41e36b278ae230e262e50cc7bcc87cb92817b5cc2e6e60478948d13a778b7b56
size 436528224

3
SakaRP-1-1.5B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13158c1f657ca2447001dcdfdf857947b3f457d873875db62ba001987b7a4468
size 601055328

3
SakaRP-1-1.5B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b55945ffa6c36d17e4764fcf27eab595eec76d670b70d793dde476a856586931
size 563810400

3
SakaRP-1-1.5B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0d0dde7484372b62730386a662532611400772fddc819616c1f2565345a3fcc
size 550327392

3
SakaRP-1-1.5B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:221b30dbe26fa7c6ca13d22a0232d10c9690e89dd4b29e309604d46f870b2fd2
size 511018080

3
SakaRP-1-1.5B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d469990b68523d0092fa9fe4252d4e1392304b91c375e8961da20308b4b70ea6
size 776664672

3
SakaRP-1-1.5B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0d467cfa78d9fe4c0b27af3fea6896c20bc3bfa3da0e2a55aea2abd6b9aaef7
size 762407520

3
SakaRP-1-1.5B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96361d88e8ce01fe8d004d30c81f6606016d997953ed13d6c01c164a03d1b063
size 731699808

3
SakaRP-1-1.5B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2a6761e4e4da495c0bd809a60dff41df77f879c9342df7b71bf2928a2996f5c
size 668792928

3
SakaRP-1-1.5B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6195bd4f567d736799dcf60b5819a87e961d1bc5af5b792d45ae2f36e49b319d
size 936331872

3
SakaRP-1-1.5B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fb76a56b634b450cd5bbd5641049343b3b175d9ebaf8519ab6e52f930814712
size 895732320

3
SakaRP-1-1.5B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2eb8817237d11018b9a4f2b6109295c4f58a6a3bc21e26473cee71bfb2fb59d
size 676305504

3
SakaRP-1-1.5B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:537dd6b25dbd94fea2aac8e2c789e83e45f3e76ed3825b54200991b7e30e65f4
size 640135776

3
SakaRP-1-1.5B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1fcde84e28456e796f947b4ede81530da1aa2d89ee0530b550857dca07bae3f8
size 880163424

3
SakaRP-1-1.5B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0e857479af2d3963d7919a51959c5b368699bc377c82fb00b201562e1d0ec06
size 824179296

3
SakaRP-1-1.5B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f00982a3276801f4c9d81588b1dba520990ad3f6f2720e38e319244ec41bf50c
size 760945248

3
SakaRP-1-1.5B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a1218d7c1ac0760ec4c0ea3581c919da7852dd6f54a97d057bd5a6b413c31c0
size 937536096

3
SakaRP-1-1.5B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60189b67885cb9be98d3b0f377e551f48ded6d0ebe9fafa6a236084602ec8489
size 1016842848

3
SakaRP-1-1.5B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7935f0dc6c5c357be55185261ef0d3ab5420f29d8131588167649db0101932df
size 986049120

3
SakaRP-1-1.5B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ae085d541a85c3c187b5112211c704ba8b6f6b508cd9b9a56e7b4f0a5c6f70a
size 940313184

3
SakaRP-1-1.5B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa18d278955103a5a53608ae9edf45f7f9ad28c74492c75d35a9be0abb4842f6
size 1125050976

3
SakaRP-1-1.5B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1485f78ab1448c59ab37f8161295b799bbb630c3f5bc9776037b964a5d4df4ff
size 1098730080

3
SakaRP-1-1.5B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb03e0de068905701954313fd9eaf201896bdd3d5e31128fbbfd84ba8ccf577e
size 1272740448

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b9086ab1490d8cc46b569f0f48fde3ff178360251aa2f237b27479987a5bf44
size 2042201