commit 74ff580f44571ddd002a0764b470e2489ef9705a Author: ModelHub XC Date: Thu Aug 20 09:41:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Spring_Dusk-8B-TIES-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..98d480f --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.f16.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Spring_Dusk-8B-TIES.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..3dbee98 --- /dev/null +++ b/README.md @@ -0,0 +1,66 @@ +--- +base_model: DreadPoor/Autumn_Dusk-8B-SCE +language: +- en +library_name: transformers +quantized_by: mradermacher +tags: +- mergekit +- merge +--- +## About + + + + + + +static quants of https://huggingface.co/DreadPoor/Autumn_Dusk-8B-SCE + + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q2_K.gguf) | Q2_K | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q3_K_S.gguf) | Q3_K_S | 3.8 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q3_K_L.gguf) | Q3_K_L | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.IQ4_XS.gguf) | IQ4_XS | 4.6 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q5_K_S.gguf) | Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q5_K_M.gguf) | Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q6_K.gguf) | Q6_K | 6.7 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Spring_Dusk-8B-TIES-GGUF/resolve/main/Spring_Dusk-8B-TIES.f16.gguf) | f16 | 16.2 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/Spring_Dusk-8B-TIES.IQ4_XS.gguf b/Spring_Dusk-8B-TIES.IQ4_XS.gguf new file mode 100644 index 0000000..5961357 --- /dev/null +++ b/Spring_Dusk-8B-TIES.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:65b47c4e4cdde9246bc2b08430909626e072a95ee63250f3cc3700fa25cef1ae +size 4484364448 diff --git a/Spring_Dusk-8B-TIES.Q2_K.gguf b/Spring_Dusk-8B-TIES.Q2_K.gguf new file mode 100644 index 0000000..71081ac --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ef71951b5f95f2ded5cab0907d4ffe3293381345f7bbf178b3e3430ffdadff6 +size 3179133088 diff --git a/Spring_Dusk-8B-TIES.Q3_K_L.gguf b/Spring_Dusk-8B-TIES.Q3_K_L.gguf new file mode 100644 index 0000000..5f65441 --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a534774741f23de4682686b1c0cd22260dfeaca0788cdb7ad3811ee80a1a0021 +size 4321958048 diff --git a/Spring_Dusk-8B-TIES.Q3_K_M.gguf b/Spring_Dusk-8B-TIES.Q3_K_M.gguf new file mode 100644 index 0000000..13a3aaf --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:950a76bff3ed56c5256b1e4ef192ef01b3026c2d47947961ec82ae1cb8b1233c +size 4018919584 diff --git a/Spring_Dusk-8B-TIES.Q3_K_S.gguf b/Spring_Dusk-8B-TIES.Q3_K_S.gguf new file mode 100644 index 0000000..4e855cf --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:08026ef8893bea1b54ef834a37521e79780d30c8f206ad47896334cc0383c4a1 +size 3664500896 diff --git a/Spring_Dusk-8B-TIES.Q4_K_M.gguf b/Spring_Dusk-8B-TIES.Q4_K_M.gguf new file mode 100644 index 0000000..966fe5f --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:31ec72041c88c8ae827c8edbc370e3be94ac8f66d7c443b765e129eaf22e1140 +size 4920735904 diff --git a/Spring_Dusk-8B-TIES.Q4_K_S.gguf b/Spring_Dusk-8B-TIES.Q4_K_S.gguf new file mode 100644 index 0000000..9e01f74 --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c97ddb150484ada9767eda11f843aa0b280680de2272eac1d4e077358d34bfd9 +size 4692670624 diff --git a/Spring_Dusk-8B-TIES.Q5_K_M.gguf b/Spring_Dusk-8B-TIES.Q5_K_M.gguf new file mode 100644 index 0000000..b876ad0 --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0667dda08f2b777e88e04d0bf17bc28364de620e3c95fb88cf63be713e2f93ee +size 5732989088 diff --git a/Spring_Dusk-8B-TIES.Q5_K_S.gguf b/Spring_Dusk-8B-TIES.Q5_K_S.gguf new file mode 100644 index 0000000..fb4c2fd --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a8fffdf0352173d7abe5cb0b2e08995d71b9a96f6419278fcc63c896b7615060 +size 5599295648 diff --git a/Spring_Dusk-8B-TIES.Q6_K.gguf b/Spring_Dusk-8B-TIES.Q6_K.gguf new file mode 100644 index 0000000..f339841 --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0450be1485c90ebd43f388cab7ef7d3c47e8a077c014a513dd0543e8ea2a68f3 +size 6596008096 diff --git a/Spring_Dusk-8B-TIES.Q8_0.gguf b/Spring_Dusk-8B-TIES.Q8_0.gguf new file mode 100644 index 0000000..d35206c --- /dev/null +++ b/Spring_Dusk-8B-TIES.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e627ecae4f5236dfa86db19e74d78432220c8dfc7ec0a3cad23dcb1a8b0852ad +size 8540772512 diff --git a/Spring_Dusk-8B-TIES.f16.gguf b/Spring_Dusk-8B-TIES.f16.gguf new file mode 100644 index 0000000..79cc658 --- /dev/null +++ b/Spring_Dusk-8B-TIES.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:535cb240dce3a1b277ad880bbf2d0b4542b9b2eb730045b5b5621b338e7c4712 +size 16068892832