commit 3f7c7bc480a964d6540e98fdc303a919f1042051 Author: ModelHub XC Date: Sun May 31 01:32:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Kistral-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..14064d1 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Kistral.f16.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Kistral.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Kistral.IQ4_XS.gguf b/Kistral.IQ4_XS.gguf new file mode 100644 index 0000000..b739285 --- /dev/null +++ b/Kistral.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4c9e51fde62073a7bf57a4b5165c1611ed21804f6aff138f4c9b99405f045e51 +size 3979796736 diff --git a/Kistral.Q2_K.gguf b/Kistral.Q2_K.gguf new file mode 100644 index 0000000..60783ab --- /dev/null +++ b/Kistral.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65b0f5d446dbca993e22558cf45e99f606ea1223d87e53ed95ab1a78ee3e6cca +size 2749351360 diff --git a/Kistral.Q3_K_L.gguf b/Kistral.Q3_K_L.gguf new file mode 100644 index 0000000..6537ee1 --- /dev/null +++ b/Kistral.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:11dcc941cda9b6d4f29c61738936a76c2163e426ce5f50ee4e74b7479a7a072e +size 3854783328 diff --git a/Kistral.Q3_K_M.gguf b/Kistral.Q3_K_M.gguf new file mode 100644 index 0000000..e79b83a --- /dev/null +++ b/Kistral.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a839462084537ddfa6230095fa2251da5ead847ca36a8c128dfd155837f29f78 +size 3551744864 diff --git a/Kistral.Q3_K_S.gguf b/Kistral.Q3_K_S.gguf new file mode 100644 index 0000000..92d42d4 --- /dev/null +++ b/Kistral.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8f686af4ce64adc108f76cc1a1b4c96f6b87d34f04cf8a837ab061b3ebb91ba5 +size 3197326176 diff --git a/Kistral.Q4_K_M.gguf b/Kistral.Q4_K_M.gguf new file mode 100644 index 0000000..0f5ae81 --- /dev/null +++ b/Kistral.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a508181b000614674c995862e58ead47d19e5f16d5fa4f7386d730cd27d44d1e +size 4404662656 diff --git a/Kistral.Q4_K_S.gguf b/Kistral.Q4_K_S.gguf new file mode 100644 index 0000000..8e9a0b1 --- /dev/null +++ b/Kistral.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b90f2993a81b2f01182e63bd2f4c10ed84042a2e29f59c43bab198f7e0a6d783 +size 4176597376 diff --git a/Kistral.Q5_K_M.gguf b/Kistral.Q5_K_M.gguf new file mode 100644 index 0000000..4c99dd6 --- /dev/null +++ b/Kistral.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e34e354134bdfd665394d729e28f5df18e6b8753834cdf212e6d0cef20d251cc +size 5170893696 diff --git a/Kistral.Q5_K_S.gguf b/Kistral.Q5_K_S.gguf new file mode 100644 index 0000000..6367c33 --- /dev/null +++ b/Kistral.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00da1578038bd23c966ca75f8365b9da34744f131c7ae3efb276ca3280c66c24 +size 5037200256 diff --git a/Kistral.Q6_K.gguf b/Kistral.Q6_K.gguf new file mode 100644 index 0000000..f9a5ecf --- /dev/null +++ b/Kistral.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95cebef425ee6dda628c29e062d6dded98ae3495a4aaf61431be289519ef2034 +size 5985014176 diff --git a/Kistral.Q8_0.gguf b/Kistral.Q8_0.gguf new file mode 100644 index 0000000..6cdea4f --- /dev/null +++ b/Kistral.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ad335179b46b4bcee63b94bf9a5f39a1c2e0f2cd67614efcf52ec325c00e0862 +size 7751442784 diff --git a/Kistral.f16.gguf b/Kistral.f16.gguf new file mode 100644 index 0000000..e0e13be --- /dev/null +++ b/Kistral.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:34731dfe5222c0db3741b119c1429cfe90697c72c468fe635b1e33ee9e17e486 +size 14589230944 diff --git a/README.md b/README.md new file mode 100644 index 0000000..1bc0b32 --- /dev/null +++ b/README.md @@ -0,0 +1,72 @@ +--- +base_model: Khuong-itdev/Kistral +language: +- en +library_name: transformers +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: [] +--- +## About + + + + + + + + + +static quants of https://huggingface.co/Khuong-itdev/Kistral + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Kistral-GGUF).*** + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q2_K.gguf) | Q2_K | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q3_K_S.gguf) | Q3_K_S | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q3_K_M.gguf) | Q3_K_M | 3.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q3_K_L.gguf) | Q3_K_L | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.IQ4_XS.gguf) | IQ4_XS | 4.1 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q4_K_S.gguf) | Q4_K_S | 4.3 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q4_K_M.gguf) | Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q5_K_S.gguf) | Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q5_K_M.gguf) | Q5_K_M | 5.3 | | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q6_K.gguf) | Q6_K | 6.1 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.Q8_0.gguf) | Q8_0 | 7.9 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Kistral-GGUF/resolve/main/Kistral.f16.gguf) | f16 | 14.7 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +