commit 52578db3289148628d0748c04b4e6dcfea551eb7 Author: ModelHub XC Date: Tue Jun 16 17:28:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Evident-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ee89c67 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,47 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Evident.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Evident.f16.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Evident.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Evident.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Evident.IQ4_XS.gguf b/Evident.IQ4_XS.gguf new file mode 100644 index 0000000..c7d115e --- /dev/null +++ b/Evident.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:acfe1bfd72681598cfffd23dab09891c395dd47348c8b196f2c74c28cb44e467 +size 4484364512 diff --git a/Evident.Q2_K.gguf b/Evident.Q2_K.gguf new file mode 100644 index 0000000..92096bd --- /dev/null +++ b/Evident.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bcbf688c8e096dffc582318a6400119ca5c40fffc8e1c3342736ecd7ec46a74d +size 3179133152 diff --git a/Evident.Q3_K_L.gguf b/Evident.Q3_K_L.gguf new file mode 100644 index 0000000..e340fd0 --- /dev/null +++ b/Evident.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:011510471027ad1b24a7ab9cda58f6d4187e7a76126cb709aea16fd12f566bbd +size 4321958112 diff --git a/Evident.Q3_K_M.gguf b/Evident.Q3_K_M.gguf new file mode 100644 index 0000000..e5fa1e7 --- /dev/null +++ b/Evident.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07d42ee6f6cb48862604046a2971c6e1254f9d13d00b55356ebcb2738d5ccb2e +size 4018919648 diff --git a/Evident.Q3_K_S.gguf b/Evident.Q3_K_S.gguf new file mode 100644 index 0000000..a96cd6d --- /dev/null +++ b/Evident.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:35699fc77b43084b1e3198301f61d62c2ee288a195c3e35449241c8dfb21026c +size 3664500960 diff --git a/Evident.Q4_K_M.gguf b/Evident.Q4_K_M.gguf new file mode 100644 index 0000000..d9f2f5d --- /dev/null +++ b/Evident.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8dc4b94323210cd3ae6df902236839cf7388a3f418fbf8d3f29d02ddfd5b1b5b +size 4920735968 diff --git a/Evident.Q4_K_S.gguf b/Evident.Q4_K_S.gguf new file mode 100644 index 0000000..b08d384 --- /dev/null +++ b/Evident.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:232aef0918f17ef47fbd4a42a8f3ec7831ba7d49f0b371322db0b2e4e57ed8ec +size 4692670688 diff --git a/Evident.Q5_K_M.gguf b/Evident.Q5_K_M.gguf new file mode 100644 index 0000000..c9a37de --- /dev/null +++ b/Evident.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3803a05d3c572c18c061780f137287c3fcc2330e99a69381da5033534ae7ab5e +size 5732989152 diff --git a/Evident.Q5_K_S.gguf b/Evident.Q5_K_S.gguf new file mode 100644 index 0000000..09d736b --- /dev/null +++ b/Evident.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f8cb3512fc3eccac49c66dadbf176ac241e80f8aeaff8ab576f01c4c8eab6e80 +size 5599295712 diff --git a/Evident.Q6_K.gguf b/Evident.Q6_K.gguf new file mode 100644 index 0000000..86da0ea --- /dev/null +++ b/Evident.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:55c658fdd3da629700400f0a75d2b06f424a2c1fdbc55a2c4f6013de3a383932 +size 6596008160 diff --git a/Evident.Q8_0.gguf b/Evident.Q8_0.gguf new file mode 100644 index 0000000..11e2173 --- /dev/null +++ b/Evident.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d74ad1d088b41c8307d633f32664c14457959c23a14becaed67ccdc8e6ed0600 +size 8540772576 diff --git a/Evident.f16.gguf b/Evident.f16.gguf new file mode 100644 index 0000000..11f1672 --- /dev/null +++ b/Evident.f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e966f1e3303ee01acfc50803d68aeeef80391c7a05210e48cd64dafd64a2f0e1 +size 16068892896 diff --git a/README.md b/README.md new file mode 100644 index 0000000..1cd3fcb --- /dev/null +++ b/README.md @@ -0,0 +1,70 @@ +--- +base_model: gizembrasser/Evident +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- text-generation-inference +- transformers +- unsloth +- llama +- trl +--- +## About + + + + + + +static quants of https://huggingface.co/gizembrasser/Evident + + +weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q2_K.gguf) | Q2_K | 3.3 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q3_K_S.gguf) | Q3_K_S | 3.8 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q3_K_M.gguf) | Q3_K_M | 4.1 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q3_K_L.gguf) | Q3_K_L | 4.4 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.IQ4_XS.gguf) | IQ4_XS | 4.6 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q4_K_S.gguf) | Q4_K_S | 4.8 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q4_K_M.gguf) | Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q5_K_S.gguf) | Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q5_K_M.gguf) | Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q6_K.gguf) | Q6_K | 6.7 | very good quality | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.Q8_0.gguf) | Q8_0 | 8.6 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Evident-GGUF/resolve/main/Evident.f16.gguf) | f16 | 16.2 | 16 bpw, overkill | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +