mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-08 00:08:13 +08:00
commit c2d35fa3a3
27 changed files with 226 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Tankie-DPE-12B-SFT-v2.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

91
README.md Normal file
View File

@@ -0,0 +1,91 @@
---
base_model: WokeAI/Tankie-DPE-12B-SFT-v2
datasets:
- WokeAI/polititune-tankie-warmup-3
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- character-training
- communism
- marxism
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/WokeAI/Tankie-DPE-12B-SFT-v2
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Tankie-DPE-12B-SFT-v2-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | |
| [GGUF](https://huggingface.co/mradermacher/Tankie-DPE-12B-SFT-v2-i1-GGUF/resolve/main/Tankie-DPE-12B-SFT-v2.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
Tankie-DPE-12B-SFT-v2.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07c01cd7af9894687a4dd66285573239c2e904e4626eceea1aa53ea6916e42fb
size 3221625088

3
Tankie-DPE-12B-SFT-v2.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a0315d8c1bc0283caa1b07c79dd78127267516bee8d14feac209c3ddcd9a8e4
size 2999212288

3
Tankie-DPE-12B-SFT-v2.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d17de90e37f3e6a2d709c1aba29ca67d549493c6b3f278d5a84668925a199f43
size 4435024128

3
Tankie-DPE-12B-SFT-v2.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a55d91c2ccf8f27a7ae9da78915460d1d6749070a9144df6247d15f5c9245c27
size 4138473728

3
Tankie-DPE-12B-SFT-v2.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:455b2447cfdec2867433f90dd731af95013d83a0ee16147595938a1bdaf50fbc
size 3915077888

3
Tankie-DPE-12B-SFT-v2.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4a44527550fcd885843c860dcdb35c6dffabaf23e1a162c55ec4e29ab6fb0b6
size 3592313088

3
Tankie-DPE-12B-SFT-v2.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72cfe2f37a297db64b49b46b8816dbc9ab86c7ceb4f8bdc197623abc1568d4a1
size 5722233088

3
Tankie-DPE-12B-SFT-v2.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17cc145a0bfbdceb7985a25e4dd4afaa3ea0b0d29bdc981b186afb8609b32dce
size 5562079488

3
Tankie-DPE-12B-SFT-v2.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50857a2cba1dee921fad8e3fadec1c26d8af90dd481631932d9ef5d5f88b9dfb
size 5306489088

3
Tankie-DPE-12B-SFT-v2.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19f4f03635a5a3f6f256cdb227d93309458385a732587b11898caf09899c384d
size 4945385728

3
Tankie-DPE-12B-SFT-v2.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e13400d54f7d51b5f54a0ddecbd73fbf2c339e4c5347627cf4e96b53905d6517
size 7097915648

3
Tankie-DPE-12B-SFT-v2.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:941d41adaed1e27fd2e46bb847995194158de5d10a33152e3904f4a0bb98c55d
size 6742710528

3
Tankie-DPE-12B-SFT-v2.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b04826b0387a776cf47eb2bff27fe234b9e82c464d96feeb67b24583c86c16c
size 4791048448

3
Tankie-DPE-12B-SFT-v2.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78314fc1e7c01c0a5c0e0715f735b31988c851482a5062d83783a1b5d315328f
size 4493678848

3
Tankie-DPE-12B-SFT-v2.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f051bac338daa6cc78e383932ea3886bac35a2ea4b643bae3b9ea4a2b78cd76
size 6561503488

3
Tankie-DPE-12B-SFT-v2.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1f77d054ed8dadb685c53b99f48bbb33e36edbbf537eb64608620a16822c2d7
size 6083090688

3
Tankie-DPE-12B-SFT-v2.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:335272e443781f1217c3024d431ac52f4495bbf25b8b6712b3600573b1d38c8f
size 5534226688

3
Tankie-DPE-12B-SFT-v2.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a5739a168ecb2b0e09af4d5317f627094b1e1761625e45dece63a863e1a3433
size 7094638848

3
Tankie-DPE-12B-SFT-v2.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d48456adea7cbf195ef37007fc4e53ca11b24a15c676864f53d7e3ea0a212b6b
size 7795218688

3
Tankie-DPE-12B-SFT-v2.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b6718d6b93ed3f592bfd6ddbfd33a6d0fcb1261b4d86474b3bfdbf3f0cc8d3d
size 7477205248

3
Tankie-DPE-12B-SFT-v2.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a316618e079d62e81ff1d79c2cb02d7aa80b3af8a9d33622ed0f2e1175270afc
size 7120197888

3
Tankie-DPE-12B-SFT-v2.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3e5bf637c08b77f95a342f8afec1d4cf46e0b4990983cf9c80accf8c906440f7
size 8727632128

3
Tankie-DPE-12B-SFT-v2.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9d39d65d0951012daff912770f7a742c242497ba4dcde0ffaa8edc3bb5a7da1
size 8518736128

3
Tankie-DPE-12B-SFT-v2.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d297862dae6bce88567c22f6b5f549d226a42f39dd3988f6d6950b118be66047
size 10056210688

3
Tankie-DPE-12B-SFT-v2.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aa023ec6827d801fc05f2ddef7b8391414ce9db37b67a9c853127c9251cf69ab
size 7088192