mradermacher/agbrain-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/agbrain-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 16:29:16 +08:00
commit a280f292fa
27 changed files with 218 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
agbrain.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

83
README.md Normal file
View File

@@ -0,0 +1,83 @@
---
base_model: benkimz/agbrain
language:
- en
library_name: transformers
license: mit
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/benkimz/agbrain
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#agbrain-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/agbrain-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ1_S.gguf) | i1-IQ1_S | 0.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ1_M.gguf) | i1-IQ1_M | 0.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ2_S.gguf) | i1-IQ2_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ2_M.gguf) | i1-IQ2_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.2 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q2_K.gguf) | i1-Q2_K | 0.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ3_S.gguf) | i1-IQ3_S | 0.2 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.2 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ3_M.gguf) | i1-IQ3_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q4_0.gguf) | i1-Q4_0 | 0.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q4_1.gguf) | i1-Q4_1 | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/agbrain-i1-GGUF/resolve/main/agbrain.i1-Q6_K.gguf) | i1-Q6_K | 0.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
agbrain.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a73bb220f8434f5c40900a1cd3b7324a951f00ee238311b5234374fc5aecb4a
size 51056736

3
agbrain.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c31d5a8100aa587837b0ccfa98a49ae4c216120475358e71a82423d27195143
size 49287264

3
agbrain.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:aabf8c5df9e3b6187d74261837a588705e65a568d30fb9c55c8ba9114b04586b
size 60180576

3
agbrain.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46b4154d681bd8ff526972a13ac098efee6753877514cf5cfdcff2fbb892b24e
size 57821280

3
agbrain.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1f94d6ba6132659d3b36be3665e60a4c9ba7813e1e3ceeff31bc3c40bc99603
size 56586336

3
agbrain.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:18d9222a27c6f25fd81f4d18fab4872cd90e76380d54378ae40a7d9abfc177be
size 54005856

3
agbrain.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a99f5d9371619a385b42ab3274e1554bab9b7b64e53f805fb598d098b59569ff
size 77637792

3
agbrain.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8de41f2f5e357c94c9f926b234378bd255c3064feeee29284897130589d3d7de
size 73564320

3
agbrain.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ac7e132dda474ea1de86cf288a2aea34b723ec20685e9c403f25d36cb105e7a
size 72568992

3
agbrain.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7fb5c4d69c3930cdb0356c9ad84005a8fa11ffeed23e61496eef7f97c2d0489
size 64788576

3
agbrain.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5c23177a29cd769d9ad9e515282d0659d4ee72b90a1b054a7393129cf99f868
size 84844704

3
agbrain.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0c1df90257effbe96bce7b5ffc4c19b4da6ff2cab6a01f6f0e0c4efd2e17d1a
size 82190496

3
agbrain.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07817afbc66510dd9695ba6ffa94a53b624cfe89997afbf8319502eb2101f4c1
size 68532384

3
agbrain.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:af5117f7b838478689e6a2d1cdab6e47a6a123baaefe3f6c56545ebe24408012
size 65491104

3
agbrain.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0df0cf80f65c382dfe2bf9f4712aa6f915d80b91ac462f6a46f173d1b61cbece
size 85508256

3
agbrain.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:669a5d7e2ee5355adc40e928da3ba2abde15490250784b933774960a82a4e3af
size 81084576

3
agbrain.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:676f59e2c839dfd0878879705ac846151aac158d1763f7ec0d9f1bbc7e7bf716
size 73564320

3
agbrain.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ceb4cbf4d8c8c28d43b274d9db02e8eb4720537418a77b7be58fcb30332fff3c
size 84992160

3
agbrain.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:08fec69df6cf728e90a000358a5edf9b935c05fe03cb5850e298fed3e5700679
size 90153120

3
agbrain.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62890f10fe95101b1dbcf714810506485a37d95dbd0e280768c28a51ee456c5f
size 91148448

3
agbrain.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35c4a332df9146c64dd81d34691275a7c673116282fe7059892bbcb00addc8c9
size 85139616

3
agbrain.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b5f45045bc171da0ec6ddc4219e925cb5c76a317e9f38bf924846237972bd1d
size 100161696

3
agbrain.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cc72823b2c8740c3261c2ef979ebad1887126609f8a273bbab692cf597e7a77
size 95461536

3
agbrain.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bd6add5e382ab24f76435798905ca233c6db87e4f11f2577ac8ce64921412fb
size 106741920

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0557ad53671c837cc3e3371767cca3e93b806de8ab78f4b526a6636cba5a05db
size 259687