mradermacher/Legal_RP-3.2-1B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Legal_RP-3.2-1B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-18 09:27:30 +08:00
commit 047a8c187f
27 changed files with 230 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Legal_RP-3.2-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Legal_RP-3.2-1B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81d700450b578f0b675e69c7fcdd73a8a3947ef27a35957dfefdbd973f4f2cd9
size 499791264

3
Legal_RP-3.2-1B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f51dfad2c155b256113f85b25ef6284760f4149c859c942ecc1ef64d02044694
size 479737248

3
Legal_RP-3.2-1B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f5f0b1674d8e3b6ae9a42ee1947e341a00bacfe6037782a6444435735daaab0
size 628311456

3
Legal_RP-3.2-1B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:914c80500dce2e521a0184ab508f578fcce818d43e3e804b7e095508b7c492a4
size 601572768

3
Legal_RP-3.2-1B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee98f79b4fc2afc58c3e5bb5d704593c8af5329629c60aa5abb7031e59b31ff5
size 562050464

3
Legal_RP-3.2-1B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee46615a8c5303d62c1b3d8958d4af51f07d280be4f40286453552cd0665add7
size 533214624

3
Legal_RP-3.2-1B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fcfe4227febf75d8ed95d87209fcb3bc0c8cf7bb89785952a5224f0f48de11d
size 770151840

3
Legal_RP-3.2-1B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54f3889d05057b77fe6b4c9e7b7766d51051ca8b2833e61be36cdf941cc558fa
size 756782496

3
Legal_RP-3.2-1B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bb5ad9b1d3617bcab66e7ae463d428bf3c68fc72a7188454b63ca331672d66b5
size 733975968

3
Legal_RP-3.2-1B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8f49eabfd591f900f044a26862a6471c05ba7e156dbef8d3ffdbe97f68497638
size 674973088

3
Legal_RP-3.2-1B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1d4da9a1ba6a8bdbe4bb226b1f3122465ee3622f357d719eef7d739c2fb92700
size 920774048

3
Legal_RP-3.2-1B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:31f8098cb2d5dc5ee558869e017187f317d19d578dc16ca2ca3577fe61b389c3
size 882681248

3
Legal_RP-3.2-1B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:994722ed7964f0de43aa42469f14122dd31890b87900bf3cc4bcad7bffe6636d
size 667059616

3
Legal_RP-3.2-1B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:816ba286b535b43b338e92b99f01508378bb44c050ca8538a4542e609080ca41
size 640845216

3
Legal_RP-3.2-1B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6544a7f7f7d45ab7f174e4cf076e853bc9e1a5130ae35dea41941c3c37938953
size 845387168

3
Legal_RP-3.2-1B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d47a532c70966657a303609230e4404dfe36ba3a3f1be7b73a7a7a317524f4b
size 803706272

3
Legal_RP-3.2-1B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e1347c678cc77e1b6df48285869950524a55309a7ff7df131760271e4d12d954
size 754554272

3
Legal_RP-3.2-1B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02e352679e6918b486c6511cf1a40355b6b9144f087e8ff0a0fd6ea9021df49d
size 920774048

3
Legal_RP-3.2-1B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49e2dfca94391f5fff7da92b18ecf41fe37afdcd2db21c8f204a817a92447586
size 995911072

3
Legal_RP-3.2-1B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a082b5c4101c31529de99a0d50eee53e0ba98132a5f98c4a219b6b6c59fd7d04
size 955442592

3
Legal_RP-3.2-1B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc5b8ad128694ccade5926aa2aca77837c171b72f3f3493f1abae3def33dd8c3
size 923395488

3
Legal_RP-3.2-1B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf6c58f4ed118bbb087315d8504bb2936f3e0e9365b01e19d6c799f46e4d707c
size 1092085152

3
Legal_RP-3.2-1B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b43166524cd7eb3f6cdf3fc1faa2947b1ea15c52fcb9f7d15bf827373ab85a8e
size 1073145248

3
Legal_RP-3.2-1B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb0191cfc46a852d19256b927db56d75c80d036322bddd105cd1d4706caf8f4c
size 1237267872

3
Legal_RP-3.2-1B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f5cfa13c0ea6eab123ac96b0fb621e8f78ad2c80f76249db69a4a160bdae2d5b
size 1328000

95
README.md Normal file
View File

@@ -0,0 +1,95 @@
---
base_model: Novaciano/Legal_RP-3.2-1B
language:
- en
- es
library_name: transformers
license: llama3.2
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- 1b
- sillytavern
- koboldcpp
- koboldai
- roleplay
- rp
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Novaciano/Legal_RP-3.2-1B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Legal_RP-3.2-1B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Legal_RP-3.2-1B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.9 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.9 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q4_0.gguf) | i1-Q4_0 | 1.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q4_1.gguf) | i1-Q4_1 | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Legal_RP-3.2-1B-i1-GGUF/resolve/main/Legal_RP-3.2-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->