commit 5a7b719c995dcb7c255486ffc33b56b587af0768 Author: ModelHub XC Date: Wed Jun 17 09:08:15 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/heretic_WebSailor-3B-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..a819be0 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +heretic_WebSailor-3B.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..708183e --- /dev/null +++ b/README.md @@ -0,0 +1,74 @@ +--- +base_model: hereticness/heretic_WebSailor-3B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- heretic +--- +## About + + + + + + + + + +static quants of https://huggingface.co/hereticness/heretic_WebSailor-3B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#heretic_WebSailor-3B-GGUF).*** + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/heretic_WebSailor-3B-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q2_K.gguf) | Q2_K | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q3_K_S.gguf) | Q3_K_S | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q3_K_M.gguf) | Q3_K_M | 1.7 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q3_K_L.gguf) | Q3_K_L | 1.8 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.IQ4_XS.gguf) | IQ4_XS | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q4_K_S.gguf) | Q4_K_S | 1.9 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q4_K_M.gguf) | Q4_K_M | 2.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q5_K_S.gguf) | Q5_K_S | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q5_K_M.gguf) | Q5_K_M | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q6_K.gguf) | Q6_K | 2.6 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.Q8_0.gguf) | Q8_0 | 3.4 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/heretic_WebSailor-3B-GGUF/resolve/main/heretic_WebSailor-3B.f16.gguf) | f16 | 6.3 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/heretic_WebSailor-3B.IQ4_XS.gguf b/heretic_WebSailor-3B.IQ4_XS.gguf new file mode 100644 index 0000000..7e31e95 --- /dev/null +++ b/heretic_WebSailor-3B.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:486a8ab4a06d02f2cce67f7a01823ccd913cea741ba1255aabed552002995a28 +size 1753403520 diff --git a/heretic_WebSailor-3B.Q2_K.gguf b/heretic_WebSailor-3B.Q2_K.gguf new file mode 100644 index 0000000..24168bf --- /dev/null +++ b/heretic_WebSailor-3B.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:997a43c3eb0ef9e73ec264d75cbb5f25c520f8f487271b064dfa1cb4fc2eb4f2 +size 1274974336 diff --git a/heretic_WebSailor-3B.Q3_K_L.gguf b/heretic_WebSailor-3B.Q3_K_L.gguf new file mode 100644 index 0000000..0d26a1f --- /dev/null +++ b/heretic_WebSailor-3B.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8f168957729ac12db24cf1846daeec50b57712431a534e57c199c2d411f2042 +size 1707610240 diff --git a/heretic_WebSailor-3B.Q3_K_M.gguf b/heretic_WebSailor-3B.Q3_K_M.gguf new file mode 100644 index 0000000..5dd5847 --- /dev/null +++ b/heretic_WebSailor-3B.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1e3011150ab7c8a7253e50dc9d6be0f82fe90a875e00d8436bdfacd2835e23b2 +size 1590694016 diff --git a/heretic_WebSailor-3B.Q3_K_S.gguf b/heretic_WebSailor-3B.Q3_K_S.gguf new file mode 100644 index 0000000..9f80ea4 --- /dev/null +++ b/heretic_WebSailor-3B.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:147c9e20be7b7e166143f6d6c1c6b1ba35c2ca49a86b5ff85a4d980dc6bf375f +size 1454575744 diff --git a/heretic_WebSailor-3B.Q4_K_M.gguf b/heretic_WebSailor-3B.Q4_K_M.gguf new file mode 100644 index 0000000..0284a52 --- /dev/null +++ b/heretic_WebSailor-3B.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:19959fa141f21c1b6c1c63d683f3650bc9ea98183c3d7bfdc9084a9280ae40e4 +size 1930121344 diff --git a/heretic_WebSailor-3B.Q4_K_S.gguf b/heretic_WebSailor-3B.Q4_K_S.gguf new file mode 100644 index 0000000..2ad5f2a --- /dev/null +++ b/heretic_WebSailor-3B.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:78ddc1e083cd86493d211cda91b63708e277ab44518d08cc78a4c34cd6a2664f +size 1834602624 diff --git a/heretic_WebSailor-3B.Q5_K_M.gguf b/heretic_WebSailor-3B.Q5_K_M.gguf new file mode 100644 index 0000000..f214c39 --- /dev/null +++ b/heretic_WebSailor-3B.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee1c558588d0e820efb61d8249ccbab860875c6fd067fdbbf09f728e63524506 +size 2225033344 diff --git a/heretic_WebSailor-3B.Q5_K_S.gguf b/heretic_WebSailor-3B.Q5_K_S.gguf new file mode 100644 index 0000000..1c5076f --- /dev/null +++ b/heretic_WebSailor-3B.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c91b94cbdaa1783a4f58297bcd527f1b3935dc24e805bebd41766e7560073ee2 +size 2169884800 diff --git a/heretic_WebSailor-3B.Q6_K.gguf b/heretic_WebSailor-3B.Q6_K.gguf new file mode 100644 index 0000000..224af9c --- /dev/null +++ b/heretic_WebSailor-3B.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9a6ec6830b6ede1af09b266d106f0b77520d7a7c7c6cf70e0cd0f0177359291 +size 2538377344 diff --git a/heretic_WebSailor-3B.Q8_0.gguf b/heretic_WebSailor-3B.Q8_0.gguf new file mode 100644 index 0000000..cad13fc --- /dev/null +++ b/heretic_WebSailor-3B.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fcda0d38f3b5415267d9fce31a4c7d74370cf9d2255137d2fdca78323c1a0670 +size 3285758080 diff --git a/heretic_WebSailor-3B.f16.gguf b/heretic_WebSailor-3B.f16.gguf new file mode 100644 index 0000000..18c0f77 --- /dev/null +++ b/heretic_WebSailor-3B.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1de8e68563de40b035143e0098b79aba181284591e84ba208016e47aa9848cd8 +size 6178844800