commit 4534afec90cf0bd72d722108f049994d87d2bc85 Author: ModelHub XC Date: Sun Oct 4 08:45:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Evolved-Llama3-8B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..88e0e31 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,57 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Evolved-Llama3-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Evolved-Llama3-8B.i1-IQ1_M.gguf b/Evolved-Llama3-8B.i1-IQ1_M.gguf new file mode 100644 index 0000000..e5f6d5c --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75833f7ff09834a95ec092e51a7c2e1645184111c29ad3c596c85d9ce84531ab +size 1754446592 diff --git a/Evolved-Llama3-8B.i1-IQ1_S.gguf b/Evolved-Llama3-8B.i1-IQ1_S.gguf new file mode 100644 index 0000000..1ccf2ff --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:936a9a1a125ecb414987bb1bff9b7819c3eb0e1b436a238608a049d1eb5ce0cb +size 1612102400 diff --git a/Evolved-Llama3-8B.i1-IQ2_M.gguf b/Evolved-Llama3-8B.i1-IQ2_M.gguf new file mode 100644 index 0000000..b8f4455 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:83f2a27c3dd9274a8f294083b761f5cee90d9552d8b2cc1aaaf562de5b337ae6 +size 2500713216 diff --git a/Evolved-Llama3-8B.i1-IQ2_S.gguf b/Evolved-Llama3-8B.i1-IQ2_S.gguf new file mode 100644 index 0000000..2b3e213 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee9ebba8f59623883c23942191bf4055b8a61903b669a7dab6a9d2d6c94e5193 +size 2310920960 diff --git a/Evolved-Llama3-8B.i1-IQ2_XS.gguf b/Evolved-Llama3-8B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..73978b6 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0059907d425046a0eed808b0744c16b6db9ced683631ecfbe4c5b743855a114a +size 2198256384 diff --git a/Evolved-Llama3-8B.i1-IQ2_XXS.gguf b/Evolved-Llama3-8B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..145d0cb --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ced05bbc1e3ad6e243442cf608134d9e981644dd991d95c416f2252d132e4d7f +size 1991686912 diff --git a/Evolved-Llama3-8B.i1-IQ3_M.gguf b/Evolved-Llama3-8B.i1-IQ3_M.gguf new file mode 100644 index 0000000..a67af0d --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71bf0bcba5095d6006cc2caed6ed3d1a51ad01d35a442cac7a8e0823af67018d +size 3284892416 diff --git a/Evolved-Llama3-8B.i1-IQ3_S.gguf b/Evolved-Llama3-8B.i1-IQ3_S.gguf new file mode 100644 index 0000000..d288333 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a20cc6026629a6e387f1b776c77dbf56fc38b16d17c279636059d5b9ffcac3ad +size 3182394112 diff --git a/Evolved-Llama3-8B.i1-IQ3_XS.gguf b/Evolved-Llama3-8B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..9b93b72 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56dd17131d091810e5a73fdfc5d0d4a5968386551493a9ab030e17fc762118a4 +size 3018816256 diff --git a/Evolved-Llama3-8B.i1-IQ3_XXS.gguf b/Evolved-Llama3-8B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..027f7bc --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c3f5365e05e375404a5b69c7eb8300611c34df3926cd6af858b214e32e288155 +size 2827344640 diff --git a/Evolved-Llama3-8B.i1-IQ4_XS.gguf b/Evolved-Llama3-8B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..3abed76 --- /dev/null +++ b/Evolved-Llama3-8B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d1d7572b29fd471b9c7a4de315c680632c4895ee055750e9f0e24adfd5de3e8 +size 3907689216 diff --git a/Evolved-Llama3-8B.i1-Q2_K.gguf b/Evolved-Llama3-8B.i1-Q2_K.gguf new file mode 100644 index 0000000..d05c46e --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a4784e3aa9b5cdbdbcc6925b336532d51cffefcf2b039e7f1dd15ee97254e05d +size 2719243008 diff --git a/Evolved-Llama3-8B.i1-Q3_K_L.gguf b/Evolved-Llama3-8B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..f5d2e57 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:acdbead179d95ba1c70c638514980fe223422a433bbee74eff785565ba0baa1a +size 3822025472 diff --git a/Evolved-Llama3-8B.i1-Q3_K_M.gguf b/Evolved-Llama3-8B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..f969553 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c11ec56483d75e384536a2143c96673801de917e7e94450550b7c0a0850eb796 +size 3518987008 diff --git a/Evolved-Llama3-8B.i1-Q3_K_S.gguf b/Evolved-Llama3-8B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..97f712e --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:90e7b320501832071969b4aa81202a5ef3cefd3ba177a8f85c4830b6419b7f26 +size 3164568320 diff --git a/Evolved-Llama3-8B.i1-Q4_0.gguf b/Evolved-Llama3-8B.i1-Q4_0.gguf new file mode 100644 index 0000000..679c739 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35a62f0072d111c667983cb110948f93a40849e4c3e1a9a593c17386d6f1d58d +size 4123597568 diff --git a/Evolved-Llama3-8B.i1-Q4_K_M.gguf b/Evolved-Llama3-8B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..bbabafc --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b72b894d4073add37d039113a7c73340a611f5d8593f2212fea0984d9cb5392d +size 4368440064 diff --git a/Evolved-Llama3-8B.i1-Q4_K_S.gguf b/Evolved-Llama3-8B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..ec32c50 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8972a4678b3ed5119dffb7e653dbddf754a9a6133f4f6bd0e3e5b3ee49584710 +size 4140374784 diff --git a/Evolved-Llama3-8B.i1-Q5_K_M.gguf b/Evolved-Llama3-8B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..4e54749 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bad86cc6828b3e432cb5c84e0a77eb30e2dbbf11ab4c82a64fc368708cbdd88a +size 5131410176 diff --git a/Evolved-Llama3-8B.i1-Q5_K_S.gguf b/Evolved-Llama3-8B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..0560859 --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ef28dc6d03c2ccc527668534d7bf115bfeb17ee51fa7ef5a051a6457cb048d96 +size 4997716736 diff --git a/Evolved-Llama3-8B.i1-Q6_K.gguf b/Evolved-Llama3-8B.i1-Q6_K.gguf new file mode 100644 index 0000000..497367d --- /dev/null +++ b/Evolved-Llama3-8B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ca55ca54fb768489b7d11cba14aaff483619e04ef33bbef889383c79b49dfb70 +size 5942065920 diff --git a/README.md b/README.md new file mode 100644 index 0000000..3209d86 --- /dev/null +++ b/README.md @@ -0,0 +1,77 @@ +--- +base_model: kinakomochi/Evolved-Llama3-8B +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- merge +- mergekit +- lazymergekit +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/kinakomochi/Evolved-Llama3-8B + + +static quants are available at https://huggingface.co/mradermacher/Evolved-Llama3-8B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Evolved-Llama3-8B-i1-GGUF/resolve/main/Evolved-Llama3-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..7430168 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9068c059bd05f6774fd53c14c1d2a18041da978b9a53637b1f52629b279940ef +size 4988157