mradermacher/SambaLingo-Slovenian-Base-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/SambaLingo-Slovenian-Base-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-05 16:07:18 +08:00
commit 09015fa258
25 changed files with 204 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
SambaLingo-Slovenian-Base.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: sambanovasystems/SambaLingo-Slovenian-Base
datasets:
- uonlp/CulturaX
language:
- sl
- en
library_name: transformers
license: llama2
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/sambanovasystems/SambaLingo-Slovenian-Base
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ3_S.gguf) | i1-IQ3_S | 3.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ3_M.gguf) | i1-IQ3_M | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-IQ4_XS.gguf) | i1-IQ4_XS | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q4_0.gguf) | i1-Q4_0 | 4.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.1 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q5_K_S.gguf) | i1-Q5_K_S | 4.9 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/SambaLingo-Slovenian-Base-i1-GGUF/resolve/main/SambaLingo-Slovenian-Base.i1-Q6_K.gguf) | i1-Q6_K | 5.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
SambaLingo-Slovenian-Base.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c2566da260ab638d2b970978af52916d63e06a3c59694c9922a724aecda63bb
size 1757035232

3
SambaLingo-Slovenian-Base.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57273c88a606ed0162e7c32b0b226dc22473d725806c98bad32b45e2ee128b29
size 1634646752

3
SambaLingo-Slovenian-Base.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c665e01e83cb3b2f846570747a8250f1246e807962afc924b8998cbc5d07e8c2
size 2476358368

3
SambaLingo-Slovenian-Base.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e238c344815e3a841c8c8e04e0226859d2c2429eb013f7ad9c0e30b78ec2c2f2
size 2313173728

3
SambaLingo-Slovenian-Base.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53379d93a13d1b30c78b47cf5d9ac0ed5949ff3cbd4fd398cba042cdcb14486e
size 2140977888

3
SambaLingo-Slovenian-Base.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f10c703005488dfc3149a96576fcf4d1cf521e2cdc4feb0e55b445dc1dc4b51
size 1961016032

3
SambaLingo-Slovenian-Base.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f06c459408444e2155a717b691cc4e271dc1eefcc32074648954e0784356ab2
size 3245259488

3
SambaLingo-Slovenian-Base.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ee5fef278d819bfcb9a253f73324ad0e0183042364ecb2b42a4823d0f208a41
size 3078699744

3
SambaLingo-Slovenian-Base.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b5b56d2e53e6df78142336a2161dd28d4e9a00b1581266e98dac480623ba687
size 2926918368

3
SambaLingo-Slovenian-Base.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e29bd73df77d92b629ccd38e7dfb729b2b86272788c187d0467d2615521abff
size 2701998816

3
SambaLingo-Slovenian-Base.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af2d0f513c0cb6f422deae601b1539f6b3c43df906198ca564a101cfeb3473bb
size 3760274144

3
SambaLingo-Slovenian-Base.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0986dc80e123e771194f701dfcc492fbf6705dac7981be0a14c333951483b78
size 2652715744

3
SambaLingo-Slovenian-Base.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d12bb325c889cf7b9dd67e5c07c4a2215e2109e5da25751b19db5a422152586
size 2439396064

3
SambaLingo-Slovenian-Base.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e3900d69f7f7f0156b415cd5a48c8004381b992ebf5e276a05eb514dd367acf
size 3727506144

3
SambaLingo-Slovenian-Base.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c7a69abfd563ecac893c7cf29b80403bc0344d4f053ad90cfc63e4b30231bac
size 3428399840

3
SambaLingo-Slovenian-Base.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0faf782f1723c6284acff1f3581f4eb71f7186622cd41430a9e1398d279187f
size 3078699744

3
SambaLingo-Slovenian-Base.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72467f0c01ba46c426ab59b09298a4cd19a0ae22094df57c916c2edc50777937
size 3981261536

3
SambaLingo-Slovenian-Base.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a86d309a065bbdaff00d7c76a564a32581669184f0c70f7320fb8d4d54b051f3
size 4225186528

3
SambaLingo-Slovenian-Base.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af52f395f27c95be0fba2364e0b237d18957125c80389d9a0a1e2fd816024c13
size 4000922336

3
SambaLingo-Slovenian-Base.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a6197a01238ba4b93d45b5ede7851c08262b05266a4a7314e737c43904a77d7
size 4940315360

3
SambaLingo-Slovenian-Base.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57e804f68c6e5078f32d1e02e905e43dde901d0f45e5901c1d09fd21b6ed6f8a
size 4808850144

3
SambaLingo-Slovenian-Base.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:246b89305e41baf02f4ee2a7ab4628cbd6ac462bdae084058735aa5278768c71
size 5700139744

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d243f5e9dcf12441a640b3cb613af2913a908ef57f83fcfe29285808d11235e1
size 4562173