From 56208c6cdf90cb462af7fe96edddca9f19959775 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Fri, 3 Jul 2026 20:56:18 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF Source: Original Platform --- .gitattributes | 50 +++++++++++ ...ired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf | 3 + ...ired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf | 3 + ...pired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf | 3 + ...red-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf | 3 + ...pired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf | 3 + ...pired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf | 3 + ...spired-Base-Hermes-3-Llama-3.1-8B.f16.gguf | 3 + README.md | 84 +++++++++++++++++++ 17 files changed, 179 insertions(+) create mode 100644 .gitattributes create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf create mode 100644 Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..d152b22 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,50 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf new file mode 100644 index 0000000..81f289d --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3425fd13c654f6ea2402bd753f7d804ce5cdc43cd3da4c42dac87e79bdd926c7 +size 3784824320 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf new file mode 100644 index 0000000..b04872c --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c70cf58e2fd876290b85eb28fa67865c31ff0e5a954f75a3460408fdf99857b6 +size 3682326016 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf new file mode 100644 index 0000000..7969029 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61060f75cdd6cffca5e534d5bbd7caff39275f0782d8454c1611702cebf0e7c7 +size 3518748160 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf new file mode 100644 index 0000000..95a917f --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:43406e4e12fda2ef6d431be36253108d9bd046e2634ae7039c1d4cd7617cf833 +size 4484363776 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf new file mode 100644 index 0000000..12196bf --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17e560969392ca6b90d0546cff9a6371538adb22ad03b3860a48deb69acc897d +size 3179132416 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf new file mode 100644 index 0000000..5089cf4 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4cae26013a22c726a39bb34ff7d918f40f53ddba33ed8f0f9a4053884a8cb9b5 +size 4321957376 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf new file mode 100644 index 0000000..0ae1e68 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1f6d52da255245bfd476c29ef3443fa8917f014e437455acf6afbc5b34e1fb61 +size 4018918912 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf new file mode 100644 index 0000000..540745b --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2f3d8fdbb4d76a18eec69e4df3dd3104a1f448243df234042b9f03fddb23c3ca +size 3664500224 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf new file mode 100644 index 0000000..8984be0 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a93cdb0442b055db350d0672b77328da8f0a8abf72cf4249eaf6f8470114f155 +size 4920735232 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf new file mode 100644 index 0000000..35c2c6d --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:878049744eedcd4e1ae542f37085f5f2c986d59b14d133db0f4375abcb3b228e +size 4692669952 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf new file mode 100644 index 0000000..d887f9a --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f66613f0bd081bd2be07eb48ec3e9078936be2d10dc573fe6f4197d277442251 +size 5732988416 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf new file mode 100644 index 0000000..f2e3bda --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2aa8217a1de8c17e4e06237e08fbb3b9a931be7bd4c8bef2d91859ded67587ff +size 5599294976 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf new file mode 100644 index 0000000..eec66e6 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b8e7e83bf58fe7a4c3cfc6f168f585c6adff966eb013e05d1085819dc5e0d799 +size 6596007424 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf new file mode 100644 index 0000000..484d18b --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:208ef01266ee64d6fd76cf3013baae835116c2e2cffa722688a3ddf6b2a4a7f0 +size 8540771840 diff --git a/Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf new file mode 100644 index 0000000..c6dc230 --- /dev/null +++ b/Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:286f7af0f79516a0b0e7fbb88f5241769af3ecae52f02127bea672ce48900f54 +size 16068892160 diff --git a/README.md b/README.md new file mode 100644 index 0000000..371e848 --- /dev/null +++ b/README.md @@ -0,0 +1,84 @@ +--- +base_model: lamm-mit/Bioinspired-Base-Hermes-3-Llama-3.1-8B +datasets: +- mlabonne/orpo-dpo-mix-40k +- lamm-mit/magpie-ultra-v0.1-DPO +- HuggingFaceH4/deita-10k-v0-sft +- lamm-mit/bio-silk-mech-data-integrated +language: +- en +library_name: transformers +quantized_by: mradermacher +tags: +- nlp +- code +- vision +- chemistry +- engineering +- biology +- bio-inspired +- text-generation-inference +- materials science +- AI4Science +- Materiomics +- Biomateriomics +--- +## About + + + + + + +static quants of https://huggingface.co/lamm-mit/Bioinspired-Base-Hermes-3-Llama-3.1-8B + + +weighted/imatrix quants are available at https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-i1-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q2_K.gguf) | Q2_K | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_XS.gguf) | IQ3_XS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_S.gguf) | Q3_K_S | 3.8 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_S.gguf) | IQ3_S | 3.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ3_M.gguf) | IQ3_M | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q3_K_L.gguf) | Q3_K_L | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.IQ4_XS.gguf) | IQ4_XS | 4.6 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_S.gguf) | Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q5_K_M.gguf) | Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q6_K.gguf) | Q6_K | 6.7 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Bioinspired-Base-Hermes-3-Llama-3.1-8B-GGUF/resolve/main/Bioinspired-Base-Hermes-3-Llama-3.1-8B.f16.gguf) | f16 | 16.2 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. + +