mradermacher/Genius-Llama3.1-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Genius-Llama3.1-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-19 23:40:22 +08:00
commit ac912f1641
24 changed files with 195 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Genius-Llama3.1.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Genius-Llama3.1.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad8e4bfbf0202c694b852d0cad829b94987c1919023f56461975c9451d61405c
size 2161972672

3
Genius-Llama3.1.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e368f536311032ec997a80089d79f31cdc4c3bde4faf0cb27a4361c9779a988d
size 2019628480

3
Genius-Llama3.1.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8d8fb41cb0012f0b423f47ab1e814fedc7fe9dbef96d48222f98f3d55c0b426a
size 2948281792

3
Genius-Llama3.1.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2eb90b2b7b38166a97aa803e0a2ff8131aeabe5768fa2b079a54fca30eb6fa77
size 2758489536

3
Genius-Llama3.1.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcc9b88b851cddbeb5e0b882f7029fa19e254b1cb46ced54a87e2f3c4e70cfd3
size 2605782464

3
Genius-Llama3.1.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57a4f16a6904fe6c0c3074d48a50570aa408f65d7e7b7252c57bc9aec29b1fc7
size 2399212992

3
Genius-Llama3.1.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6ba2b1c60b1e4bf2b9eb8cc47dc50fcda67aa3f4a5b33a347f8e779f755db11
size 3784824256

3
Genius-Llama3.1.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0cc5d9c735a82b0d5acd5cade0220d4d602a3c7d9020a7cf56dcbf945ad3d6cf
size 3682325952

3
Genius-Llama3.1.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9a77f702ec073066383bd7dba6867ea6df66ee676ffbfa943d0e397d229ec87
size 3518748096

3
Genius-Llama3.1.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c09a794a953ed3fef1727f186703bce9429cafeb0a78cb1d3064087821fd570d
size 3274913216

3
Genius-Llama3.1.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2739961b9ee7f8fe4499b42a275ea0997f4053f93f7384be46fa321180bdc478
size 4447663552

3
Genius-Llama3.1.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9895ca0df89117766f6ae8e24f60730c112235891d0b4d79292784070e2fd070
size 3179132352

3
Genius-Llama3.1.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab8ff8d8293dc8d739013d7c9795ff672cc6302141799849b1b9a7f0dd061c26
size 4321957312

3
Genius-Llama3.1.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07ba01e4c0b987836e15eae6826b9baaa18310cd02949736be586121a139ca4e
size 4018918848

3
Genius-Llama3.1.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c99187643e62e0a83ab16c58718ab6777cb2b37af5a6ef10d352ce688354e5e0
size 3664500160

3
Genius-Llama3.1.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c99a7a7b587a5f59793eff56957608ffdd4e9aee58462a2674ca6850c5e33a1
size 4675892672

3
Genius-Llama3.1.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a272bb2a6ab7ed565738733fb8af8e345b177eba9e76ce615ea845c25ebf8cd5
size 4920735168

3
Genius-Llama3.1.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d677003d1a0d2c3cc221160bae853e5be7c82938c607563434aa2ce86c17268
size 4692669888

3
Genius-Llama3.1.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ac69d1e011f81531911d9867b0b1be7a38bd246eb992daaa14922455383dff6
size 5732988352

3
Genius-Llama3.1.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:385da5f7790b3cb1d34e52c8368824a310e0d2a251c02dd842338008df15bc37
size 5599294912

3
Genius-Llama3.1.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2f4dfd5d4a0137deadfc676cc0faffc0f5ce720a2ff68ca6426a1f7b86615c17
size 6596007360

72
README.md Normal file
View File

@@ -0,0 +1,72 @@
---
base_model: Ksgk-fy/Genius-Llama3.1
language:
- en
library_name: transformers
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Ksgk-fy/Genius-Llama3.1
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Genius-Llama3.1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Genius-Llama3.1-i1-GGUF/resolve/main/Genius-Llama3.1.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4193cb6210ff0dc2f5ab3bd594c28fec0500bbe91d464be5027326f0259fe4e5
size 4988157