commit f8fdb558958b546e37ebff303a50e98521f90385 Author: ModelHub XC Date: Wed May 20 09:25:10 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..9c59528 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,58 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf new file mode 100644 index 0000000..ca64c73 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bd10a6629166b58bca1d240e00026914a9a0a9736a8d80b207756f59b1b3fd98 +size 3138611104 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf new file mode 100644 index 0000000..baf71b0 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61fc628b61969e1fc42a04c4fe2099b3e8bc24dfd8ff2fa1a1c8afdf04590c0a +size 2898687904 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf new file mode 100644 index 0000000..ac919ce --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ffdb7b706f55560263cfbee7397a059afcb523d128f31ecd8c0f97c622bfbc0 +size 4517580704 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf new file mode 100644 index 0000000..96c8518 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:482f10b6719afe4d9d96c46247e10648fcc2041d5d77eba879870510e2747790 +size 4197683104 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf new file mode 100644 index 0000000..2d3d1d4 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:64956e764fa6b35142fa127bfeb3405d84e2494b42eb17079dfb6bc8d0f760d7 +size 3891148704 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..a4470ee --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee7fea382093c34500707c6d2dbd95ddb894a41c2455893186a5e916d506c3d0 +size 3538483104 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf new file mode 100644 index 0000000..8bc7a94 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c04d4e3bac0882f08ef05f84d61c0b539c79126472f6eb5f16a7a4a0c304dae4 +size 5984511904 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf new file mode 100644 index 0000000..760dcf1 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:87134126407c614cd766485ba451ee296f8ac3d374ca41f16bdedf37acd27192 +size 5658982304 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf new file mode 100644 index 0000000..cc1bedf --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4fde22f791bc20bb25147591075e21c486597b8d5216c3829e19fc7e1691da0 +size 5361612704 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..dc52315 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d6facd5f73ba2252a908f3a65d50c00fbd3775c9531f168792a79f8e4cd2d5be +size 4960563104 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf new file mode 100644 index 0000000..a34efd3 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2fdb5b5343886f57ae6de1a83a5ee7654080d5363161bf259b0855082cfb405e +size 6964223904 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf new file mode 100644 index 0000000..cec1cfd --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:edf711159c639ac680cec1bb998b87b0e626500c62beff6a544dc46e552015b9 +size 4854271904 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf new file mode 100644 index 0000000..db8137b --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1861bf913d5f5c581cf3ac398a8e2b35d8da24d1d5d03255a9caa8279b067ea0 +size 4436684704 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf new file mode 100644 index 0000000..7f1d65f --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f28c8800c7b17b0b18e6322c41ba8050f2df37d105021b3a6af810e878763cc +size 6929561504 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf new file mode 100644 index 0000000..bb67287 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e209b35160bd375d9cad966a1dae28b39c9e121f14265a3b4afe448423a3ada +size 6337771424 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf new file mode 100644 index 0000000..f3fb2cc --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9920cc59e18eb0a96757c26873d8bab171724178868ecdad5b022503647385b +size 5658982304 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf new file mode 100644 index 0000000..f5706c9 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3952bc75e9d7925a5c7958cbf85c6a2b8633ba3e6643a86e05a8c84208c05323 +size 7387955104 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf new file mode 100644 index 0000000..5991a5e --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3245f10a3acb907658b00dd73c68dc290eb0c63555fc38fd32407bc7e1839b56 +size 7865958304 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf new file mode 100644 index 0000000..da321e6 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ff5cbe1505acd3ec7f2bd127713c4a4c5823a96f9d1d5e42a157c17c8a86d519 +size 7423180704 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf new file mode 100644 index 0000000..384ebda --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:58ef93dc541bd9cc38581d48057a92dc9fc3ccabd32e98b8f27c9da3987956e4 +size 9229926304 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf new file mode 100644 index 0000000..ff13d3d --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5df46229968e8c2594e54702742964929751d0ab86c54a47d67ca492acdf10ab +size 8972287904 diff --git a/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf new file mode 100644 index 0000000..05032f1 --- /dev/null +++ b/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:54d8e85b4119ce985a872b04e586a4712ae9dba44646f72436a6a1dc6336ae5b +size 10679142304 diff --git a/README.md b/README.md new file mode 100644 index 0000000..e2c6402 --- /dev/null +++ b/README.md @@ -0,0 +1,79 @@ +--- +base_model: DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp +language: +- en +library_name: transformers +quantized_by: mradermacher +tags: +- merge +- mergekit +- lazymergekit +- KoboldAI/LLaMA2-13B-Tiefighter +- DavidAU/D_AU-Tiefighter-Giraffe-13B-32k-slerp +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/DavidAU/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp + + +static quants are available at https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | | +| [GGUF](https://huggingface.co/mradermacher/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp-i1-GGUF/resolve/main/D_AU-Tiefighter-Plus-Giraffe-13B-32k-slerp.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..6485eda --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b13ba446388518dfb5a501bb05f5a7239b12b651d5adbafb06bf00df0c78359 +size 7136325