mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 09:25:10 +08:00
commit f8fdb55895
25 changed files with 206 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

58
.gitattributes vendored Normal file
View File

@@ -0,0 +1,58 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd10a6629166b58bca1d240e00026914a9a0a9736a8d80b207756f59b1b3fd98
size 3138611104

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61fc628b61969e1fc42a04c4fe2099b3e8bc24dfd8ff2fa1a1c8afdf04590c0a
size 2898687904

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ffdb7b706f55560263cfbee7397a059afcb523d128f31ecd8c0f97c622bfbc0
size 4517580704

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:482f10b6719afe4d9d96c46247e10648fcc2041d5d77eba879870510e2747790
size 4197683104

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:64956e764fa6b35142fa127bfeb3405d84e2494b42eb17079dfb6bc8d0f760d7
size 3891148704

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ee7fea382093c34500707c6d2dbd95ddb894a41c2455893186a5e916d506c3d0
size 3538483104

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c04d4e3bac0882f08ef05f84d61c0b539c79126472f6eb5f16a7a4a0c304dae4
size 5984511904

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87134126407c614cd766485ba451ee296f8ac3d374ca41f16bdedf37acd27192
size 5658982304

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4fde22f791bc20bb25147591075e21c486597b8d5216c3829e19fc7e1691da0
size 5361612704

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6facd5f73ba2252a908f3a65d50c00fbd3775c9531f168792a79f8e4cd2d5be
size 4960563104

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2fdb5b5343886f57ae6de1a83a5ee7654080d5363161bf259b0855082cfb405e
size 6964223904

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edf711159c639ac680cec1bb998b87b0e626500c62beff6a544dc46e552015b9
size 4854271904

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1861bf913d5f5c581cf3ac398a8e2b35d8da24d1d5d03255a9caa8279b067ea0
size 4436684704

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f28c8800c7b17b0b18e6322c41ba8050f2df37d105021b3a6af810e878763cc
size 6929561504

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e209b35160bd375d9cad966a1dae28b39c9e121f14265a3b4afe448423a3ada
size 6337771424

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9920cc59e18eb0a96757c26873d8bab171724178868ecdad5b022503647385b
size 5658982304

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3952bc75e9d7925a5c7958cbf85c6a2b8633ba3e6643a86e05a8c84208c05323
size 7387955104

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3245f10a3acb907658b00dd73c68dc290eb0c63555fc38fd32407bc7e1839b56
size 7865958304

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff5cbe1505acd3ec7f2bd127713c4a4c5823a96f9d1d5e42a157c17c8a86d519
size 7423180704

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:58ef93dc541bd9cc38581d48057a92dc9fc3ccabd32e98b8f27c9da3987956e4
size 9229926304

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5df46229968e8c2594e54702742964929751d0ab86c54a47d67ca492acdf10ab
size 8972287904

3
D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54d8e85b4119ce985a872b04e586a4712ae9dba44646f72436a6a1dc6336ae5b
size 10679142304

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- merge
- mergekit
- lazymergekit
- KoboldAI/LLaMA2-13B-Tiefighter
- DavidAU/D_AU-Tiefighter-Giraffe-13B-32k-slerp
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b13ba446388518dfb5a501bb05f5a7239b12b651d5adbafb06bf00df0c78359
size 7136325