mradermacher/Predonia_V2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Predonia_V2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 18:30:11 +08:00
commit c680e43e74
26 changed files with 216 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Predonia_V2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Predonia_V2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text

3
Predonia_V2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a5c5fd95ecb9ac5224905cfddaea80c9ab9892a79ebbad3e7b211a5135cc77b
size 5750494944

3
Predonia_V2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:206bb11ea3f45f783563670538c47394ff7c551c2b997795f5c963ca90e8e3c5
size 5273720544

3
Predonia_V2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d8b9e30f97fa3e6f2109270c9758c145b6a66cfa7a5bd7fb50e754ff2049b8e
size 8114050784

3
Predonia_V2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3556de74223a3e030d9259e8beeeadea9c53bf4ece832a7ac44b57e2b24c1b57
size 7478351584

3
Predonia_V2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c651a16d9eeb27ff4b7ea7f1a8639cfced4a8dd0d8fdf1cc623172d7de6cef1c
size 7207032544

3
Predonia_V2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be93dab596215839f54df9496fa99031aa1f95e48df33073545a4e719633dfc7
size 6545118944

3
Predonia_V2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:408d198071f581bd29d4f1647d64f4bbe4af7ea3e7e8c9e14e2f8280420fd75b
size 10650949344

3
Predonia_V2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f0276d1d8346704ccdc77923cd709f8868d07481f56a5ed2f114ded9cfd3598
size 10428126944

3
Predonia_V2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7207fb887f3c922a28d5ba132b41b79b34d1c34f98d9983a8a177c085486acad
size 9907115744

3
Predonia_V2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:db56387700d27379945c82d2dc5848dede6f9bc9124567c75dbca8bbbaa40878
size 9280591584

3
Predonia_V2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e06eb6959825b2b596d642236fd038e51e2e275bcdc32efab0ddb9cf52dbd3f5
size 12758914784

3
Predonia_V2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d69b00c30a1077e83e9f3011bfc67bef8ec935b0df360f8e6b7ed8b0c71411a
size 8890324704

3
Predonia_V2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ad1839b4742ce738058b280dd91c9f53c75f8bb5ba3b4d68e0815ab6a2d9e28
size 8320161504

3
Predonia_V2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a47efaf06847ef60b95e83ab89be9a43f28ea5260ce29a3d6f3234a1d3da6c26
size 12400760544

3
Predonia_V2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b234bb333e7442d15f26452c830126580fdf4f8245b3a5cfdb9f47f379fb9187
size 11474081504

3
Predonia_V2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:243bfcbf9d5a0c7d3aa031f433361a9e1595e2798f3be43260039b088589a7df
size 10400274144

3
Predonia_V2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8b409593dd2bcd842f4173da42d1dada7cc92f8ad502205a51015459a0104d3
size 13494228704

3
Predonia_V2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:329dd094a6255e9833c6e77a90287de137e7a9d2345919c45616b65b9c138518
size 14873106144

3
Predonia_V2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cebcbccc78d3dc63cd5c5a922973fed38c22dfe69c04a1d2b40ba1390d7e54d
size 14333908704

3
Predonia_V2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32b513dd65027229c5b378fdfeca13c454f41a1c096c63d853b7132380c87122
size 13549278944

3
Predonia_V2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a74537a0e01d8c74d8f8135879dd549073334f8aabc51eec85373f3be0a0808
size 16763983584

3
Predonia_V2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3c4a40b9b919599b5ece98968efa84376ea7c36958ef0bd52c65ef373bf23f9
size 16304412384

3
Predonia_V2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:122f0803388a01da17c9224676a65285aee0c38ced92a8800892b11ecbef82be
size 19345938144

3
Predonia_V2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c55f5de12bd568eaf79c3e3ae36eeea8bd271a2d89afcb2d691a2659bd1795c
size 10037312

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: Ateron/Predonia_V2
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Ateron/Predonia_V2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Predonia_V2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Predonia_V2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/Predonia_V2-i1-GGUF/resolve/main/Predonia_V2.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->