初始化项目,由ModelHub XC社区提供模型

Model: mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-30 17:07:17 +08:00
commit bc05ff9944
25 changed files with 203 additions and 0 deletions

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: securin/Securin-LLM-V2.5-Qwen-1.5B
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/securin/Securin-LLM-V2.5-Qwen-1.5B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Securin-LLM-V2.5-Qwen-1.5B-i1-GGUF/resolve/main/Securin-LLM-V2.5-Qwen-1.5B.i1-Q6_K.gguf) | i1-Q6_K | 1.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35981c8986c7f5cf33ab7c786667cb8099ac7cd37f88ee48e85dd25480db67ea
size 464168416

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39b23e4a41ca7c8aca4d348eaf5312814bc093539ba6de8e2857ed0d15200c6b
size 436234720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3608df12dd36502861f7929b50cb03c61c26783b2414205aa3967a5344635e2a
size 600761824

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8bce807bfcd1f85204f98c799dfd25ef88cdbacaa281092647e1136c9ad171bf
size 563516896

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dec6a8484cf12f475fa18b640abad87d3bf8f81acda8b7f347e4cccb07410d7d
size 550033888

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:214800d2c0f51067e39bcb2d532fe32b81779f0a079c3ff351b113488f25120b
size 510724576

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d017e92315f9e5ed47eb97c2bbf04ce99d03322fc8079d5d8fbfe8f329c36142
size 776316096

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e36cce9a8b68d6057136ab05a4a6759b8ec864e0584e3be1395e33f0411c9e5e
size 762058944

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f4d9507bd607fd5590e7846baaaaf0e7f037eba0fd63e1e1006b4d64530fce4
size 731351232

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6239bbbf1f9cde906c6f34eaae45772adf56af8de2ada3baf893a94ba0d8592e
size 668499424

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dd869de053cefee28af7dc4d55f6c22b9eee0788223af0818c070db62d6d136
size 895383744

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44d0c158935fec8beae45919bfdb5be757b2cbe9ed85604288cc801467d60454
size 675956928

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61809a8ab2a59322fdd60a5d6089944a3e3ad4d94d3d7e4ec78a34f70059abe4
size 639787200

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78834648db4531e450547750ae6dc32761f47c7b560a3b05983b92ee8514688d
size 879814848

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fb8a225c29160836ef2d09df2f710942ffa1905c48c1c209b8bf8f085fe6ea5
size 823830720

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bfd281d30a41c81f504e701fbfd16019642ac10ce1222f97c62135103df62a39
size 760596672

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c77855eee20bf9acb78f61fb82877d5ddc9fea9a42cbd24b2a92bacc9b69661f
size 937187520

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95774be8cef94b28e0c93bf82cf498d6493a61057e37827e4d12fcfd10b789ea
size 985700544

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16c3d57f5614d9c00bbbb4283e69bcde155b2f3d0e6ad02d06ae3936f4f83d44
size 939964608

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d5e44ef1df4c60e6ee40272f1bd3743ac3f63f3ed478ea3e70564b73512c23d3
size 1124702400

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a65b4fd12d40c050da76c560b09bf32a4cd3e7922615464cded6201e1f29384f
size 1098381504

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb17ae400d145223f64c9ed2334f016cb59e13587b05069a908b68e26166cd17
size 1272391872

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c105050895eaa714c604267669058a7c23ca34235f143350179f48554a9a6b12
size 2042201