mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 02:58:09 +08:00
commit 004b902e85
25 changed files with 197 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Thespis-34b-DPO-v0.7.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text

70
README.md Normal file
View File

@@ -0,0 +1,70 @@
---
base_model: cgato/Thespis-34b-DPO-v0.7
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- not-for-all-audiences
---
## About
weighted/imatrix quants of https://huggingface.co/cgato/Thespis-34b-DPO-v0.7
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ1_S.gguf) | i1-IQ1_S | 8.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ1_M.gguf) | i1-IQ1_M | 8.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ2_XS.gguf) | i1-IQ2_XS | 11.0 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ2_S.gguf) | i1-IQ2_S | 11.6 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ2_M.gguf) | i1-IQ2_M | 12.5 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q2_K.gguf) | i1-Q2_K | 13.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 14.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ3_XS.gguf) | i1-IQ3_XS | 14.8 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q3_K_S.gguf) | i1-Q3_K_S | 15.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ3_S.gguf) | i1-IQ3_S | 15.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ3_M.gguf) | i1-IQ3_M | 16.2 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q3_K_M.gguf) | i1-Q3_K_M | 17.3 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q3_K_L.gguf) | i1-Q3_K_L | 18.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ4_XS.gguf) | i1-IQ4_XS | 19.1 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-IQ4_NL.gguf) | i1-IQ4_NL | 20.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q4_0.gguf) | i1-Q4_0 | 20.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q4_K_S.gguf) | i1-Q4_K_S | 20.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q4_K_M.gguf) | i1-Q4_K_M | 21.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q5_K_S.gguf) | i1-Q5_K_S | 24.3 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q5_K_M.gguf) | i1-Q5_K_M | 25.0 | |
| [GGUF](https://huggingface.co/mradermacher/Thespis-34b-DPO-v0.7-i1-GGUF/resolve/main/Thespis-34b-DPO-v0.7.i1-Q6_K.gguf) | i1-Q6_K | 28.9 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->

3
Thespis-34b-DPO-v0.7.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a5a3afb0dd07eb70738e4c39a79b3d554c612f8112ed7d37a78a347bd37f572
size 8778897440

3
Thespis-34b-DPO-v0.7.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6680e1d4a854f12e9f7b194388f7f3b5b9a3a2f684b99b355c2c60225b5a655f
size 8101091360

3
Thespis-34b-DPO-v0.7.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43ebfdaa845d3e6e669e4f08c55a2fe4c9307e9e3bd47a94231e940eba06994b
size 12396873760

3
Thespis-34b-DPO-v0.7.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e83c822574a202f1204352fbac83c4f63a83f6d8b2a9088a1aed8db71186cd72
size 11493132320

3
Thespis-34b-DPO-v0.7.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a123f678cfeb77a563598d41df4c9fb1b09efbd9385f8d6e4125f9aa6ad295b5
size 10908653600

3
Thespis-34b-DPO-v0.7.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b76a747505826ea121cb3366349df670a605f8005732999893843ae5a5a79fe7
size 9908574240

3
Thespis-34b-DPO-v0.7.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b5f1381b995de72f8e9ea02c8983179697d28490cfb5ca09ddf8eb9a7360174
size 16105883680

3
Thespis-34b-DPO-v0.7.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ec2b418cb6947457f520f98cb10267b3874fc069a7d5e94015e7f076532925d
size 15559968800

3
Thespis-34b-DPO-v0.7.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2a4e9b6b2afd660ba49d56d56a0bcce550e93293be6ec9a08f64890ddcb1eca
size 14717012000

3
Thespis-34b-DPO-v0.7.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9b25d62656ac83a4658e5c050640336f021d94abc0f69b9d23d99ec5a44e9be
size 13935986720

3
Thespis-34b-DPO-v0.7.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:09bbd5b2aa7188ffc68c8274195fe72aef94262e7dd6248b96b6209dcf3d1c22
size 20062763040

3
Thespis-34b-DPO-v0.7.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52462e132cd99713368f0e11ec1cd134a290bf22c4c165b635dd5a78e5338e77
size 19016235040

3
Thespis-34b-DPO-v0.7.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f74462c476a37f2c668e41c97c4a0f3b4d2925750fa7f5f64b4bad9b6f84b357
size 13366417440

3
Thespis-34b-DPO-v0.7.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7b16a0ba2261bee5339549c3a9694b5452d0aadcd13bd517736ce3d9d42f75d
size 18680629280

3
Thespis-34b-DPO-v0.7.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4b965a55aebd663cbfb4d8b86e865481ffa05f954dacc84f8adf2638993dd81
size 17196107808

3
Thespis-34b-DPO-v0.7.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eff829f27cabc88ca3f083742137ebb19a7a8ed9d79f629ec0c77cbe81e72db6
size 15501477920

3
Thespis-34b-DPO-v0.7.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:214a438a4fc6ef9e8a825acdf3d4f6071d0e013b6a5cb38e9fff9b78192b8e42
size 20071938080

3
Thespis-34b-DPO-v0.7.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1063cc21b9f61b5f7a9cd173ffdc74f5860acfb009f9ac540ca8d7b693e5db19
size 21199894560

3
Thespis-34b-DPO-v0.7.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c3bcc6e4b04ca50e8f4d1742f30e7d692b3faf604b701f33c92493891fd75dd
size 20139833376

3
Thespis-34b-DPO-v0.7.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35cb536442682ce62e0ad476105e2f774cb68469f7de1dcf7ac409bf8d16e0e1
size 24863029280

3
Thespis-34b-DPO-v0.7.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4b144bfff925ca3dc67109a9ae2f457e96a55e48d262333680a72e2b7f7eb07e
size 24248875040

3
Thespis-34b-DPO-v0.7.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3befc2fdef0d32133ef6d7c5e13da35b6c33e77a190108d3b8fdc9de89b797ff
size 28755109920

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cf2433adbc200b91afab8332c7adce6ff8b25f366b70c868c77d8a2bf49999a
size 15251034