mradermacher/pgt-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/pgt-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-17 19:05:16 +08:00
commit 008e25ef4c
27 changed files with 211 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pgt.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

76
README.md Normal file
View File

@@ -0,0 +1,76 @@
---
base_model: christofid/pgt
language:
- en
library_name: transformers
license: mit
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/christofid/pgt
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/pgt-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ1_S.gguf) | i1-IQ1_S | 0.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/pgt-i1-GGUF/resolve/main/pgt.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:798163fea173eeb55a642fd63bb82f72d96896f5234db762e379a9203628d9fa
size 259687

3
pgt.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:653c157a00714c1bef41f8a27e2f987a43c0df84c7ced4452d6889cb1ab2a430
size 51058784

3
pgt.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd167025a506a756ee64ab4e727edd7686bf1ad030d44cc35b4fbf107dbbc8a7
size 49289312

3
pgt.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aac1a92904cc827132a599c7e8c8ae3eff0ee7ce64dfcc65fcb78c72c21d63f0
size 60182624

3
pgt.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab76ce3bddbdb6169c0ea2a683e5b26e93575266a2b53f7ee345a9500a3dc177
size 57823328

3
pgt.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75e79e8d96dd7131f98251dfe8064f6f91240b5db2d9cf6e707a2e7c2ff8e916
size 56588384

3
pgt.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9db900803eb5e4068a0e484d4499c2a07c7e321633b5f838d4b5d09c4b92df7
size 54007904

3
pgt.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11f88fcb5181ed85c25dd51e100902613f04d816dab42eb814689d26b3549cc2
size 77640256

3
pgt.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba89ed74aade429b5b2537edc65d2640c103116bf2f973318995f1a779ae1caf
size 73566784

3
pgt.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb709b605f196672f63d237720b0b585598fe41f1e549c1413df21e8c87d7d87
size 72571456

3
pgt.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:021c47437f4854cad8aa9364bd155c49bc98c3c5fc0dba6d4ac2476becff94c4
size 64790624

3
pgt.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8259aed47adc955864c0dff1d81c1a893b970cb8db3eadade4b3db36a5ef3151
size 84847168

3
pgt.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52acab9f1a7257c0cce9874d156a9ccee7f3a5144422db159af44c2fac7a3a47
size 82192960

3
pgt.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:824d6d881e9e20daba73ae8622d5f1dc7264844e45b622bf0c000c8073803f53
size 68534848

3
pgt.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:990e6e2315c2cebd095ecb917fa75987e54ba27d1c71a14102e1aa1e45bd5f72
size 65493568

3
pgt.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec2882806bda5e7f65bf73439de9ce506bf25360d50370983788147591717a4e
size 85510720

3
pgt.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8eb6cfb29dc2e77007f85a74c4999e0c6954ebf5738ce311ea61f2f371f1917d
size 81087040

3
pgt.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e6a19840c28698949a7b23f2e100f6c066e1fc689475f574f6b69699c4dbabd
size 73566784

3
pgt.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40ac1a9fe6863a3508c57807d9a04403b8636e201e4e5a97ecc67302b14d377b
size 84994624

3
pgt.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd35eba2c10d6ebb547c2e7d41fc4c5ee6d698e2f1742741d103786a31fb6225
size 90155584

3
pgt.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a567ecf0d45799d5d171b065059af3e896f3dbcaad43a93c959f09fe2740db3
size 91150912

3
pgt.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e3b735d562c91ab3d85061607e3ccb9df60648f0b18e54256668aaab3c8674c
size 85142080

3
pgt.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ccba290df5a49a0c60bd5bed407148598af29f819cfa0a4196ca6015f92d1c21
size 100164160

3
pgt.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c451eeb6aff10d5c6bc81a978d8483091ebd85835ff391d1512b3f52801eed28
size 95464000

3
pgt.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72ca6f80976864055de4e409c6bbd0a013507a7d223e3f16ac4fe3e44c10134a
size 106744384