commit bcd1ba84548f63c7e560f52c56e816c0de1cf225 Author: ModelHub XC Date: Fri Jul 3 00:42:18 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/s1.1-0.5B-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..bbda8d0 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +s1.1-0.5B.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..49cea35 --- /dev/null +++ b/README.md @@ -0,0 +1,78 @@ +--- +base_model: 2stacks/s1.1-0.5B +datasets: +- simplescaling/s1K-1.1 +language: +- ar +- de +- en +- es +- fr +- it +- ja +- ko +- pt +- ru +- th +- vi +- zh +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +--- +## About + + + + + + +static quants of https://huggingface.co/2stacks/s1.1-0.5B + + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q3_K_S.gguf) | Q3_K_S | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q2_K.gguf) | Q2_K | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.IQ4_XS.gguf) | IQ4_XS | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q3_K_M.gguf) | Q3_K_M | 0.5 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q3_K_L.gguf) | Q3_K_L | 0.5 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q4_K_S.gguf) | Q4_K_S | 0.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q4_K_M.gguf) | Q4_K_M | 0.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q5_K_S.gguf) | Q5_K_S | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q5_K_M.gguf) | Q5_K_M | 0.6 | | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q6_K.gguf) | Q6_K | 0.8 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.Q8_0.gguf) | Q8_0 | 0.8 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/s1.1-0.5B-GGUF/resolve/main/s1.1-0.5B.f16.gguf) | f16 | 1.4 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/s1.1-0.5B.IQ4_XS.gguf b/s1.1-0.5B.IQ4_XS.gguf new file mode 100644 index 0000000..dbb56dd --- /dev/null +++ b/s1.1-0.5B.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4acf0549dd1b01d70dcf9f5f20cd074304d9b200cf0044337ab75079adfed5a5 +size 428021696 diff --git a/s1.1-0.5B.Q2_K.gguf b/s1.1-0.5B.Q2_K.gguf new file mode 100644 index 0000000..6c8a15e --- /dev/null +++ b/s1.1-0.5B.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:104c932e1bd9b5b783bff43d2ab0d50ac3dd6bef9588f39cd0a9e1d9975d65ad +size 415183808 diff --git a/s1.1-0.5B.Q3_K_L.gguf b/s1.1-0.5B.Q3_K_L.gguf new file mode 100644 index 0000000..d5fc864 --- /dev/null +++ b/s1.1-0.5B.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9797ed1421222f96f03d9403d4c1683edbd814b31a40ff5a7a75e54fc4d45861 +size 445934528 diff --git a/s1.1-0.5B.Q3_K_M.gguf b/s1.1-0.5B.Q3_K_M.gguf new file mode 100644 index 0000000..426c7e3 --- /dev/null +++ b/s1.1-0.5B.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:70cda95fae4df64f7a8377e913d28d55b3e6daf2e0ffb61e7df1aaa3d9be1906 +size 432042944 diff --git a/s1.1-0.5B.Q3_K_S.gguf b/s1.1-0.5B.Q3_K_S.gguf new file mode 100644 index 0000000..d0eea34 --- /dev/null +++ b/s1.1-0.5B.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5de6a8f251644e88fdfd02a26e65574df7cc38602f23c26c68b5309c181d8a27 +size 414839744 diff --git a/s1.1-0.5B.Q4_K_M.gguf b/s1.1-0.5B.Q4_K_M.gguf new file mode 100644 index 0000000..ce68e17 --- /dev/null +++ b/s1.1-0.5B.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d5d60c11acdebd25c40b81d0048e9437523db6743631befeac09797f29c855b9 +size 491401152 diff --git a/s1.1-0.5B.Q4_K_S.gguf b/s1.1-0.5B.Q4_K_S.gguf new file mode 100644 index 0000000..0b9661a --- /dev/null +++ b/s1.1-0.5B.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:51bbcde90d7420d436081d362db1e0aa99386d073bb448213a70f0b937c2e3b4 +size 479065024 diff --git a/s1.1-0.5B.Q5_K_M.gguf b/s1.1-0.5B.Q5_K_M.gguf new file mode 100644 index 0000000..d9b34c8 --- /dev/null +++ b/s1.1-0.5B.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a33df4d5e1fe2fcf1dcea81d72faa45d08dc3a83f8d8e1da96d0cf8a5d50bb84 +size 522187712 diff --git a/s1.1-0.5B.Q5_K_S.gguf b/s1.1-0.5B.Q5_K_S.gguf new file mode 100644 index 0000000..4007bbf --- /dev/null +++ b/s1.1-0.5B.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5563b0763f748dca0b8e7ce479fd1a1ce14f628770b8e8adc6dad121440774e9 +size 514811840 diff --git a/s1.1-0.5B.Q6_K.gguf b/s1.1-0.5B.Q6_K.gguf new file mode 100644 index 0000000..8169ecd --- /dev/null +++ b/s1.1-0.5B.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:490e8800f81f52f04da598fc624fec3e32757fe38a8a8706d3c649c2d49e468e +size 650380224 diff --git a/s1.1-0.5B.Q8_0.gguf b/s1.1-0.5B.Q8_0.gguf new file mode 100644 index 0000000..bc70306 --- /dev/null +++ b/s1.1-0.5B.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96914a5c9bc94f6b9540c74db81709caa811301254e7ba1b9a2fc2b6aace441a +size 675711936 diff --git a/s1.1-0.5B.f16.gguf b/s1.1-0.5B.f16.gguf new file mode 100644 index 0000000..7ac1d4a --- /dev/null +++ b/s1.1-0.5B.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6de398f25bbc70fb48d02e4976be1e65131977b0577a3ba316443674654f99be +size 1266426816