mradermacher/Proto_Leech-3.2-1B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Proto_Leech-3.2-1B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-23 10:14:16 +08:00
commit 238018dcc6
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Proto_Leech-3.2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Proto_Leech-3.2-1B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5eb8c6e4a642af52e07aa7a2b9edf4fa39a3859b4119ca4043c386c9a143beb6
size 413603200

3
Proto_Leech-3.2-1B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:244c22a1acc46e2a5ce7fbec72d9f10cca701d247142af3fb3978ebd75b986b6
size 393549184

3
Proto_Leech-3.2-1B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c4da2955189ec80e8769c88b9b20d8ecd1e6ea780db4d53612b4e14af625c17
size 515446144

3
Proto_Leech-3.2-1B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:99f3cc58e866b131ff64b43d454bb315489daf9a46c1a69c969801b14386e00f
size 488707456

3
Proto_Leech-3.2-1B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a41c222ed1048901963ec5c57ae5549c1b78e5e18a4f4be928df40b091703405
size 475862400

3
Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11392e8e26f1ca10ada904f7ccafdc7d2ce1b505917d0683c5e106de79413dcc
size 447026560

3
Proto_Leech-3.2-1B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a8d7fa7ab637c80c6ad4f1b3a1d6a9ed4f0c7c15603a791b12f881b2175f1c0
size 657286528

3
Proto_Leech-3.2-1B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ed2890dc5f68b4a5d9b2a2eb2d656a9dd8d6e0f025f329728f46f98b4c9fd0f
size 643917184

3
Proto_Leech-3.2-1B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3304c19ead70cfcc5df7f3362b1bc8b7ad493490ee3a3efbebd3fa25aebac78
size 621110656

3
Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b642bb12feaade27c2329b8928d18b23800e043c8d66a7b91af70911448843a0
size 562107776

3
Proto_Leech-3.2-1B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3212ed393db8133648ebd158746b5d4e3dc5ed7a8b19426885c9fb33d4aeed2b
size 773023104

3
Proto_Leech-3.2-1B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b325616db721338a09c26f749e96be6b1a8e85129fa3c3550aba22d5514cc010
size 743138688

3
Proto_Leech-3.2-1B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02563086bc2d6f8a934f70b62d1f26fa61b057cd0beb02b88473082724e1785c
size 580871552

3
Proto_Leech-3.2-1B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f45be40137efabe0ec67aeaecb514bbdda3deaf289a4f2f333170ef604e79b40
size 554657152

3
Proto_Leech-3.2-1B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a8379c4f58444500c211a62db3ea99c2b7b1337a8b650e94b88d1527f528b41
size 732521856

3
Proto_Leech-3.2-1B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f4ea3bb66e27371c4e1d4d5c0953630cb30471c2a901841c26a88ddf0bcc07f
size 690840960

3
Proto_Leech-3.2-1B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3ba8ed8ac8dd83203fec7733d039cde0368ff464c596b3c287992ebace3c60b
size 641688960

3
Proto_Leech-3.2-1B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce39a388827c8cb75f278cdb2761dbc7b599901f625a9b436bda282152ac1e88
size 773023104

3
Proto_Leech-3.2-1B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bdf915f406c257341d024a7d0ecce80056a98cad9d0fa2730f18451689cf7f7d
size 831743360

3
Proto_Leech-3.2-1B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c997fcb54386b93ea8e85ab5d942caa3d0f782df5b69d5991ff62b48e266a5e7
size 807691648

3
Proto_Leech-3.2-1B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c39d57a0557e1f3741e8804e4cb429c4d0942e45430daf04c76b1701c840cc2
size 775644544

3
Proto_Leech-3.2-1B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:719c562ecc969989cc7315a10b27b1963d91e5c1339c00a9d9a601a317e641c0
size 911500672

3
Proto_Leech-3.2-1B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cd4f1f9762f4bfa762393e1e529bc233734744752391c691888f1dbe76bf9ff
size 892560768

3
Proto_Leech-3.2-1B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:681f0837937f944964b534fb3090d53c6efe688a00edb0fa7fee06cf169180ea
size 1021797760

3
Proto_Leech-3.2-1B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ec0a0d2081637e6f5a8dc21a724f9a3d08aca1c46987d0620f8bf2243a969fa
size 1328000

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: UmbrellaInc/Proto_Leech-3.2-1B
language:
- en
- es
library_name: transformers
license: llama3.2
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- unestable?
- prototype
- experimental
- uncensored
- abliterated
- merge
- not-for-all-audiences
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/UmbrellaInc/Proto_Leech-3.2-1B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Proto_Leech-3.2-1B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.5 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.7 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.7 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Proto_Leech-3.2-1B-i1-GGUF/resolve/main/Proto_Leech-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->