mradermacher/DarkIdol-Aria-4B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/DarkIdol-Aria-4B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-09 23:26:15 +08:00
commit 3a0658c800
27 changed files with 229 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DarkIdol-Aria-4B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
DarkIdol-Aria-4B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:542b601670baec1d4da0fa3de0a2285df7b76e0760f84f9a9dd9df6e0fb191ec
size 1199572160

3
DarkIdol-Aria-4B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85debaebdb215ae0178595492cfea5e55628bd4b358fbe80c3fefe495929f901
size 1133094080

3
DarkIdol-Aria-4B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bbb12077c16643c0348c7b411f8ed8d831e516f385e084cc5395a609a38fa01c
size 1537983680

3
DarkIdol-Aria-4B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9151092e49c4450921427939aa1487820e276ded14737f3fe51870925f4b1149
size 1449346240

3
DarkIdol-Aria-4B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:67b4409c6d1d9fab1f8df824d396e15d1b820cd0854be24498ba50ed0ee0c770
size 1404576960

3
DarkIdol-Aria-4B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:501e2c5a9f590dc25f13f455d862209336a68b36b69f544af1ab611f64911cb9
size 1310368960

3
DarkIdol-Aria-4B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b97efba1841095ac47c115860ef6217704c85fe38b3c0c33a7b54a5b9e4de856
size 1986804160

3
DarkIdol-Aria-4B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:501be6e5c7c616106a4026bd8af0c3990a9011162844c1039c5e442d8a909c5f
size 1937365440

3
DarkIdol-Aria-4B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:df38e4f7e2e2c12e8544d6b773877e7a05779cc82dc183084b2024d256d8b851
size 1863391680

3
DarkIdol-Aria-4B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6de265375407a023adff5fe09b492ee590f60dd46665947fdb99b870f10f79f
size 1689453760

3
DarkIdol-Aria-4B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48efd24f5740911b39925fe9173c83052d8a722a6b97b576cb4c55d95fd8c5bb
size 2363513280

3
DarkIdol-Aria-4B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb72aaeba599ceec65ee3497aca419a306b1d7ed90e9ce5766ea937f78bc3079
size 2263243200

3
DarkIdol-Aria-4B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25ddd571ae1b9610b2fdd7d2bbc22ea78eb3ce9d303080a1b06b170859c44d52
size 1729165760

3
DarkIdol-Aria-4B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b61cb2c9f4d58db0b1b366f9af13e78c0b4018fb6c6f6db350671d9d399e03d
size 1636063680

3
DarkIdol-Aria-4B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ede0c3c27a51029addd52cc86bec004ca980ab4b5c5fa1377d0350139a436fa4
size 2236086720

3
DarkIdol-Aria-4B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:43a77ce0343ca8283617a220d265d436c31e117ce41f0973922131b4d351b803
size 2098461120

3
DarkIdol-Aria-4B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f15e1e14854344e54250bf2e7d512f046f91213ec835c4d503cb1a1d0c14170e
size 1937365440

3
DarkIdol-Aria-4B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7156e2c5216944b8df2fe960a60d456168ad7c0938ad5cc3a37858bd70338b35
size 2370066880

3
DarkIdol-Aria-4B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cea5c25ae7e08c1484c227de173ad23a52448aa549dc57b525693c923085dd82
size 2564053440

3
DarkIdol-Aria-4B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a415e1d35d78d3365265c17be2ef4aca3c4573cc99eed431d3f41c1c82c49381
size 2489895360

3
DarkIdol-Aria-4B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2388ce3ccbae5e604e978697db7c44d8e88eac4e36e6ffc30cf07ee3be9db129
size 2377931200

3
DarkIdol-Aria-4B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c17c27ec83abf8b041c13d4bd83f138a3f2f35077bcf86acb1ff1b9e89205d70
size 2829699520

3
DarkIdol-Aria-4B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2faeab1e9bb55a08418c13605a886fff11b7ab5ae01659914bbee01438d18483
size 2764593600

3
DarkIdol-Aria-4B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae46db325317861b241411cb83be8aa82308937470f5d9485d3a2181d8b14867
size 3190741440

3
DarkIdol-Aria-4B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2468b52f80865b0e999a7e13b7008bd24b7dd5b4c97879b69eccda010edc43e3
size 3448608

94
README.md Normal file
View File

@@ -0,0 +1,94 @@
---
base_model: aifeifei798/DarkIdol-Aria-4B
language:
- en
library_name: transformers
license: gemma
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- roleplay
- gemma
- sillytavern
- idol
- youtube
- google
- pytorch
- DarkIdol
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/aifeifei798/DarkIdol-Aria-4B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DarkIdol-Aria-4B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/DarkIdol-Aria-4B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.2 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.7 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.8 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q2_K.gguf) | i1-Q2_K | 1.8 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ3_S.gguf) | i1-IQ3_S | 2.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 2.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ3_M.gguf) | i1-IQ3_M | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 2.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 2.3 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q4_0.gguf) | i1-Q4_0 | 2.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.5 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q4_1.gguf) | i1-Q4_1 | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/DarkIdol-Aria-4B-i1-GGUF/resolve/main/DarkIdol-Aria-4B.i1-Q6_K.gguf) | i1-Q6_K | 3.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->