mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-12 12:58:16 +08:00
commit 89a5d9b709
26 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
aquif-3-moe-17b-a2.8b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: aquif-ai/aquif-3-moe-17B-A2.8B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- language
- aquif_moe
- text-generation-inference
- 17b
- qwen-like
- bailing-like
- science
- math
- code
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/aquif-ai/aquif-3-moe-17B-A2.8B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#aquif-3-moe-17b-a2.8b-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ1_M.gguf) | i1-IQ1_M | 5.7 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.2 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 6.5 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ2_S.gguf) | i1-IQ2_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ2_M.gguf) | i1-IQ2_M | 6.9 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q2_K.gguf) | i1-Q2_K | 7.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 7.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 7.6 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 7.7 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 8.1 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ3_S.gguf) | i1-IQ3_S | 8.1 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ3_M.gguf) | i1-IQ3_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 8.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 9.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 9.3 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 9.6 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q4_0.gguf) | i1-Q4_0 | 9.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 10.3 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q4_1.gguf) | i1-Q4_1 | 10.7 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 11.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 12.0 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 12.8 | |
| [GGUF](https://huggingface.co/mradermacher/aquif-3-moe-17b-a2.8b-i1-GGUF/resolve/main/aquif-3-moe-17b-a2.8b.i1-Q6_K.gguf) | i1-Q6_K | 15.2 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
aquif-3-moe-17b-a2.8b.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52a0c29c8c24c3bf9100c15a14ac7054acaa869c94a2df4296b1c4a5ad91eca7
size 5636267104

3
aquif-3-moe-17b-a2.8b.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e06d8575c21f32dc1178527d6963373b5d618d483fa5e25612e9f19eabd549ee
size 6796491872

3
aquif-3-moe-17b-a2.8b.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b248529861d0f802a7f7e07011294acb517281f05f9f7b6ea1ae27eaff7d6a1e
size 6453984352

3
aquif-3-moe-17b-a2.8b.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fd942f36ce937935c1a4c629a797f0f35a322b1c35a7b96587904c32fcafc12d
size 6410579040

3
aquif-3-moe-17b-a2.8b.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c98badf95fd8f6f4a7241ea42d8a8a303fbcd7a15abf893da3c559040ff63c0
size 6064401504

3
aquif-3-moe-17b-a2.8b.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ecf8f47d5117b4ede5c952a93c19b9a754408ec14f0c4ee2903333a531330ae
size 8116767840

3
aquif-3-moe-17b-a2.8b.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1742b692c19e67aa36a0d47ed3f917d2bf5e60f19dcfe0ce47f5f5f708be9d4a
size 8029666400

3
aquif-3-moe-17b-a2.8b.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8dc86f5c5d561cb056d8dab048ee7f5768457700446cf33ba961e47b950c2a2a
size 7648099424

3
aquif-3-moe-17b-a2.8b.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62751842e97c8b6105a6f6305dc896c3ecb4fd0562d4bb17466c5672c91c98db
size 7472061536

3
aquif-3-moe-17b-a2.8b.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b242068658eed474373a08a5c770d76bca18ade3594403b323b3bdaf0aba275a
size 9539755104

3
aquif-3-moe-17b-a2.8b.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1dfee00fb36a47f08fa000aa92a1607d305efc8e25c97207c36c2a54feeeaef2
size 9185303648

3
aquif-3-moe-17b-a2.8b.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b7cc864a08c53f1a88d1039ee4f0bb64f2b0cb285530ce11ae9e8fcb56a75e1
size 6906027104

3
aquif-3-moe-17b-a2.8b.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7546761ad4c4d337e9dfc241c36f8e8020aed1bb4b026fbced823ff80ceb589f
size 6950960224

3
aquif-3-moe-17b-a2.8b.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b61871fed2a50960de3dac704bfeb7af3c983fc902cfe24b094b81f63a0388ae
size 9074130016

3
aquif-3-moe-17b-a2.8b.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76c7491a6a13268736392da7d5c8d38823816e044d682a660fd51bcbee04de34
size 8725150816

3
aquif-3-moe-17b-a2.8b.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10d6d08173409bc2863c961ad5a484df27799f74c44068da5b79a0d8b06a31a5
size 8025767008

3
aquif-3-moe-17b-a2.8b.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b5559d2f6100897af13ad8a8d85b337e3dae7ff04a691431c601f7547ba5129
size 9571769440

3
aquif-3-moe-17b-a2.8b.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b382521d391a37d4c60478af5edb195a6ab6ab91ba6a850672cc2ca7b593857
size 10569784416

3
aquif-3-moe-17b-a2.8b.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c662e3f4836b360706f014134fcfeaac27cbfd1049b0694d9fb623279ac237d0
size 11175492704

3
aquif-3-moe-17b-a2.8b.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73224c0f649b303e8453e9b0abfa40b442f6cf56b846c0fe0064adf625ca2e9b
size 10219297888

3
aquif-3-moe-17b-a2.8b.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75cfc7124d6bcbc4a554132c9b053bf99b2d1d4213b12f10d8cb2c0b43c330aa
size 12746521696

3
aquif-3-moe-17b-a2.8b.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c7a0f2b63c2577ee9c09d77a8aaefbd58d7992570aee91313f1c908e73aa4fd5
size 11926445152

3
aquif-3-moe-17b-a2.8b.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:caf99d0d2bc19c496ff3f8302233da4f309baeb3c84d6f536aa9a1ecc54000ef
size 15051570272

3
aquif-3-moe-17b-a2.8b.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41672cc95cb17971e2eecde895a3f7fdc9b821d5b500b4026c1f4d4afc3ed961
size 41443264