commit a31d008f029527acbc85fb1fb06b5bee09df069f Author: ModelHub XC Date: Sun Jun 21 17:39:15 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/humanoid-butler-model-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..c429ecd --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +humanoid-butler-model.f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..7293475 --- /dev/null +++ b/README.md @@ -0,0 +1,74 @@ +--- +base_model: rfuiid8/humanoid-butler-model +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- generated_from_trainer +--- +## About + + + + + + + + + +static quants of https://huggingface.co/rfuiid8/humanoid-butler-model + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#humanoid-butler-model-GGUF).*** + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q2_K.gguf) | Q2_K | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q3_K_S.gguf) | Q3_K_S | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q3_K_M.gguf) | Q3_K_M | 0.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.IQ4_XS.gguf) | IQ4_XS | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q4_K_S.gguf) | Q4_K_S | 0.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q3_K_L.gguf) | Q3_K_L | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q4_K_M.gguf) | Q4_K_M | 0.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q5_K_S.gguf) | Q5_K_S | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q5_K_M.gguf) | Q5_K_M | 0.2 | | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q6_K.gguf) | Q6_K | 0.2 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.Q8_0.gguf) | Q8_0 | 0.2 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/humanoid-butler-model-GGUF/resolve/main/humanoid-butler-model.f16.gguf) | f16 | 0.3 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + + diff --git a/humanoid-butler-model.IQ4_XS.gguf b/humanoid-butler-model.IQ4_XS.gguf new file mode 100644 index 0000000..ba9e031 --- /dev/null +++ b/humanoid-butler-model.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4ae2c7738870eb6472ee7483483b7bc09e3bb8331e661c0acd77e473b6db875 +size 59386080 diff --git a/humanoid-butler-model.Q2_K.gguf b/humanoid-butler-model.Q2_K.gguf new file mode 100644 index 0000000..0130146 --- /dev/null +++ b/humanoid-butler-model.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8e3822802128b0dc3660303c2241f499c90fcb11397aec8bc393177511074ef +size 52557024 diff --git a/humanoid-butler-model.Q3_K_L.gguf b/humanoid-butler-model.Q3_K_L.gguf new file mode 100644 index 0000000..aca26ce --- /dev/null +++ b/humanoid-butler-model.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3e8d3784d3c120f6b559d8b388d3ea69544cba3d218a6d611b0a5e08ad02d5f5 +size 61044960 diff --git a/humanoid-butler-model.Q3_K_M.gguf b/humanoid-butler-model.Q3_K_M.gguf new file mode 100644 index 0000000..8934e96 --- /dev/null +++ b/humanoid-butler-model.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f443f3f466dc0db07cfd13f7f52061ebdc7c0e064e9b34138b75155470a1276a +size 58833120 diff --git a/humanoid-butler-model.Q3_K_S.gguf b/humanoid-butler-model.Q3_K_S.gguf new file mode 100644 index 0000000..5ebe4ed --- /dev/null +++ b/humanoid-butler-model.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cdae21f9674c6d47dd24c5b241624be8776fff449c6f16125b6e1c54d891978e +size 55072992 diff --git a/humanoid-butler-model.Q4_K_M.gguf b/humanoid-butler-model.Q4_K_M.gguf new file mode 100644 index 0000000..d41451a --- /dev/null +++ b/humanoid-butler-model.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f662d3bb2c75df21019d2a9bbb14c43de5e4b261786e623c672f86a75ad5719c +size 63256800 diff --git a/humanoid-butler-model.Q4_K_S.gguf b/humanoid-butler-model.Q4_K_S.gguf new file mode 100644 index 0000000..b90eeb2 --- /dev/null +++ b/humanoid-butler-model.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:512dce399a26bb18e22155ff430985b794ad24111a30d0dfeb401d75fdf5131c +size 60713184 diff --git a/humanoid-butler-model.Q5_K_M.gguf b/humanoid-butler-model.Q5_K_M.gguf new file mode 100644 index 0000000..d86b6ab --- /dev/null +++ b/humanoid-butler-model.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0dc70f48ed757b10e012de0334eb6416c0788b272cc0e2ced9097a7b26a11175 +size 68058336 diff --git a/humanoid-butler-model.Q5_K_S.gguf b/humanoid-butler-model.Q5_K_S.gguf new file mode 100644 index 0000000..ff7ac27 --- /dev/null +++ b/humanoid-butler-model.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7dfeb5d6e5d1faf684281f0faeaef72ae3e162dccbbad92de42d04d53ce7f285 +size 66021600 diff --git a/humanoid-butler-model.Q6_K.gguf b/humanoid-butler-model.Q6_K.gguf new file mode 100644 index 0000000..6a6b56f --- /dev/null +++ b/humanoid-butler-model.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0584e071fd70fae2a8b731be8a01beef70dceb323465ff2347c3d2740da2fe10 +size 71661792 diff --git a/humanoid-butler-model.Q8_0.gguf b/humanoid-butler-model.Q8_0.gguf new file mode 100644 index 0000000..f163caa --- /dev/null +++ b/humanoid-butler-model.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dce041b813f803691fe6a3a850c64bf3d3e5bac7902c420e8a589950d6cc964c +size 91294656 diff --git a/humanoid-butler-model.f16.gguf b/humanoid-butler-model.f16.gguf new file mode 100644 index 0000000..191ff8f --- /dev/null +++ b/humanoid-butler-model.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4542b2e8729261eba226e56658b78a9fd36f12b0448d4c6d08fd92bc7c07fe41 +size 167292800