mradermacher/AceGPT-13B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/AceGPT-13B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-10 08:51:17 +08:00
commit a0bd2c34dc
28 changed files with 216 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

61
.gitattributes vendored Normal file
View File

@@ -0,0 +1,61 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
AceGPT-13B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
AceGPT-13B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c284fcf0df68ecc11a626907a75b5857ec9f9430585a9a184e103f73acc33074
size 3138610240

3
AceGPT-13B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dd7052f0e471c67ee962ed8b7eb435c7a221f98174f0e0e1ed1dfd58d3d9f8cb
size 2898687040

3
AceGPT-13B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e60436a777084bedea67204f68370f03b6aa35c92bc2c6e4948c1ca9ba36c61d
size 4517579840

3
AceGPT-13B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a765253566055539815caa7474660c937e1dc63e29a9daa02f147ca5f092ad0
size 4197682240

3
AceGPT-13B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e388332fadfc941ee37bae7f5e3aa53a21e2f6eff650d5a2606575602b1e05d7
size 3891147840

3
AceGPT-13B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d376f2cb60e0e4e56d21799613bfa76e03561d10a0b907a5aeb11dc0ca8fd1d5
size 3538482240

3
AceGPT-13B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6bef601101f0c90691e17e128c88763b8c948d24016b397e7fb638ee4713455b
size 5984511040

3
AceGPT-13B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f73a2951ce507b695b5a91cb2ae5dc5002d47c3b74dc451124f45166acbf2a4
size 5658981440

3
AceGPT-13B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d01a10587ba0733ed7e76b74bcfca83dbc90dfa9114502c4e1f326dd811ef60
size 5361611840

3
AceGPT-13B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2ab367cd467085745d9ca692c0456a9ed9046f5ce046945a2300752123f67c4
size 4960562240

3
AceGPT-13B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e2a1ca9b79741e6ce06d67c147da33fb316710708bcc41778e875e48401020f
size 6964223040

3
AceGPT-13B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0be8eb49333fc25484d294996b03dd63564dbb2354c05ed6eb85104861c4d0b9
size 4854271040

3
AceGPT-13B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:144629a91834de9f6464fd454ad49fbc5a3cafb32ccc8545a9601e282ca7bda2
size 4436683840

3
AceGPT-13B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e8b69654c6341ed0f5a65cff40330d89f6d79d0452500b385ad20505be8e2b1c
size 6929560640

3
AceGPT-13B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fee21712c4b13401c95db79833bcce51b68876ed59e46f76c1306e5f11cf4e31
size 6337770560

3
AceGPT-13B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:446c652c83afa00e01a6e8a0411f557c949f3392711698d0a1acff863bdc2a8e
size 5658981440

3
AceGPT-13B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7208c0c7568edf785b28af067a26c4d82639ab87b96b593e315c93bd361a4c64
size 7387954240

3
AceGPT-13B.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:de7387ec95c6eb4175ef60c827f8890d2942f0cfc4163e57ae45731a9ae19fa8
size 7365835840

3
AceGPT-13B.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce80203c3dfd6acee66e1b18a46b9345bcd771763f068c44a6e6fc9077a41f2e
size 7365835840

3
AceGPT-13B.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2b4f1b58ff4fe6af421c5f7e717213122388614f15fdcd55e5e92855d10ec9d
size 7365835840

3
AceGPT-13B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abed502339fcd7f7225a419f91d95927588dcee99bf81a073d1caaecbab5043f
size 7865957440

3
AceGPT-13B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21a2f711e013cc556d3213eebf10eeaccf8b8652981a9b4b6c6fb96e1fdc9c11
size 7423179840

3
AceGPT-13B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72ed6659915e10dc44de776caf81fe525bcd6d2e65d0a87da35d6dbd00100590
size 9229925440

3
AceGPT-13B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85ed49ad07a3a8406fdadfeb7a3bc32d6be4edd5787652622e11c9ee12c5eff1
size 8972287040

3
AceGPT-13B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c59ed90d67f4cc14621bd71a8ff3e451dc7da27192191a48791d63ffd3967d2
size 10679141440

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: FreedomIntelligence/AceGPT-13B
language:
- ar
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/FreedomIntelligence/AceGPT-13B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/AceGPT-13B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.5 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q2_K.gguf) | i1-Q2_K | 5.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.1 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ3_M.gguf) | i1-IQ3_M | 6.1 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.0 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.1 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 7.5 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 7.5 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 7.5 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_0.gguf) | i1-Q4_0 | 7.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 8.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.1 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/AceGPT-13B-i1-GGUF/resolve/main/AceGPT-13B.i1-Q6_K.gguf) | i1-Q6_K | 10.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fe0a629a545f855d0fbf9ab70ae46f5254282238ea8f2f7ec4fe4891bc5c0331
size 7136325