mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-20 11:31:09 +08:00
commit b8c550e977
27 changed files with 220 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
PLLuM-12B-nc-base-2412.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
PLLuM-12B-nc-base-2412.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:95aa78dc4c9e96661e155826856834e57826a2a569e6a8ac831c10371046735a
size 3221624128

3
PLLuM-12B-nc-base-2412.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b27b01c1a0f0f1e8d248312ee4f91fbb90684a4e464710bbff04dd438e03c0f
size 2999211328

3
PLLuM-12B-nc-base-2412.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc21d97fdbc4c9b806704e568451cfa46816facb81a789f32b7a233726564e4f
size 4435023168

3
PLLuM-12B-nc-base-2412.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:245d309a5c3a72118ccbde38ce669536ffe25118508657f33767fed99c88594a
size 4138472768

3
PLLuM-12B-nc-base-2412.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c814598de85ac98e90ef3fdfb8f550b0a5da54ac237c083355890c2ab08f0dda
size 3915076928

3
PLLuM-12B-nc-base-2412.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d08678d210503e979cf595f703778a250f1722a439209b627fd21e503f2326e
size 3592312128

3
PLLuM-12B-nc-base-2412.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d305851915af13a76f56aae93697a4044b497513924ca2ec10020be23a2653e
size 5722232128

3
PLLuM-12B-nc-base-2412.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:773918753ebdfb6599b991ff4738af4659537605c0f570881ba2882d6cddc11d
size 5562078528

3
PLLuM-12B-nc-base-2412.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37dd204e93b018870fc8784fb0f54f802b1149fa5a0a875d0dfe7e8aac7d8625
size 5306488128

3
PLLuM-12B-nc-base-2412.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b34b95a7f3476e1f1911bcbb6c3327495b64d3c8582574c15f647fb60cc725d1
size 4945384768

3
PLLuM-12B-nc-base-2412.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf1b25fe4ab7fdae6aa276ce372fb3d11c3bf6b77a6946a910f61768af4ce147
size 7097914688

3
PLLuM-12B-nc-base-2412.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f9dbe1f31d6295d1a2edbf152e83ba978d60ed39cb9df1e4119b681a8de1e9ec
size 6742709568

3
PLLuM-12B-nc-base-2412.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b02f58217df33ed943e202d32a2aaacf1a971e28664e78facac3ca4bca9ea1dd
size 4791047488

3
PLLuM-12B-nc-base-2412.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97cdfae559466c6c3ade6d15f3b3348f56e85639c2ee96b207d8aeccc278cb33
size 4493677888

3
PLLuM-12B-nc-base-2412.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:833c26e056ea6c7629a35ef3da2716979d1608be62da872a79b483e54c29fa1c
size 6561502528

3
PLLuM-12B-nc-base-2412.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:820d0bbaddfda37a387a9d51d469684b47c308db13bacd764845aad770cff4ec
size 6083089728

3
PLLuM-12B-nc-base-2412.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b96b6b429a269b0546c2c9dbe310c8368e30904bb968cea9b3a1b31bfeb4ae35
size 5534225728

3
PLLuM-12B-nc-base-2412.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b6772086fcc521f4443358f3aa2f4d125016ce1e855eb38d35e13f50d21f485d
size 7094637888

3
PLLuM-12B-nc-base-2412.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bc0f657931b9fd1102f0cf1cb6091c3ac2a05f36aa7dfce8e1f01a0d2717f84
size 7795217728

3
PLLuM-12B-nc-base-2412.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:269f1cef6e8cdacc889d3ce09c1dee319d499469d089c7d57bd3fbe811aa545a
size 7477204288

3
PLLuM-12B-nc-base-2412.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa994e37da6bee247f9037843bb1be0133c725282fe44df20510b895eb205d20
size 7120196928

3
PLLuM-12B-nc-base-2412.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39afa2f9d25b665f13b6e8d9604b1bdb1bb2f39b636dd3fc0ce5119b6647ec11
size 8727631168

3
PLLuM-12B-nc-base-2412.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a33384c859db3620f4eb13aca1bb6199244db1e9f9f5c54a0fb4943a74f8b0dc
size 8518735168

3
PLLuM-12B-nc-base-2412.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44a88aae97a9a56312018bf397786940d6a12923f554966f81547e3eec84a109
size 10056209728

3
PLLuM-12B-nc-base-2412.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da4e50891e5dae684261f0b16bad09cd0d0b0056dca69fbe1b595298dec860f6
size 7088192

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
base_model: CYFRAGOVPL/PLLuM-12B-nc-base-2412
language:
- pl
library_name: transformers
license: cc-by-nc-4.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/CYFRAGOVPL/PLLuM-12B-nc-base-2412
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#PLLuM-12B-nc-base-2412-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/PLLuM-12B-nc-base-2412-i1-GGUF/resolve/main/PLLuM-12B-nc-base-2412.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->