mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-08 21:25:19 +08:00
commit 666cf08e2d
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text
Haruhi-Zero-7B-0_3.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Haruhi-Zero-7B-0_3.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:007d4c862d76c3f6c884ef1229270d11735c2955979952751d51ddc4d8568dad
size 2097960448

3
Haruhi-Zero-7B-0_3.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10953deede6710112790cab4af8eed01e858bac5f56b6eb7ca353dc19240dd2b
size 1962989056

3
Haruhi-Zero-7B-0_3.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21030d23775706c8a02a32ea4946d0b9bb75bd41b2887cd01846a87027fe4788
size 2856633856

3
Haruhi-Zero-7B-0_3.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f53886ca4cb7e042812fdf970e6ff401b657e62c4050861c570dbe83ad8653fe
size 2676672000

3
Haruhi-Zero-7B-0_3.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:172632bbeaa56b15d61ae728496649659cd1a35583116390b3bc6351a013073d
size 2519651840

3
Haruhi-Zero-7B-0_3.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9127d5c8d5a80ca895596ca3396f648c995db9693efeee9eab87cdbb0f33d0b3
size 2322912768

3
Haruhi-Zero-7B-0_3.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e8679fdcab20edc65b2a6ac94dfda248ec4b3370b0891a64a1a2fe8507767e9
size 3878319616

3
Haruhi-Zero-7B-0_3.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2b859e301e0cbd5cabf1afc764590257f1855cbd3f654e40b8d82c68d809f510
size 3569153536

3
Haruhi-Zero-7B-0_3.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87529fa96c4f31ac9cbba5115a57cd59f0d5c7866f61c781f2101edc4f09370e
size 3467703808

3
Haruhi-Zero-7B-0_3.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:992f0fd289cc242c166a65227c23ac7d74045f6e1303d73556f0e2fe96f65c66
size 3208103424

3
Haruhi-Zero-7B-0_3.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b4788c52428afea2b6fadb985efae1f6376bf0cd2c16620330f0808fd199e30
size 4290078208

3
Haruhi-Zero-7B-0_3.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85eda853a34a0d04467943d9f4aa4ae42f180c962e4d83e04be955116c925a01
size 3049293312

3
Haruhi-Zero-7B-0_3.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e6a4c6cdec56ccbecaec289f930e8ec824ccf57a4c9c8a9dc12e1b00b84d3a54
size 4293457408

3
Haruhi-Zero-7B-0_3.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:add0a58f6f52c6775fb1b5e99f679837698ba26b3cfc3a3b930c0153416e4ea4
size 4057265664

3
Haruhi-Zero-7B-0_3.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bef51f202be5610baaf1c1bb9ceb4ece9630598727a5d4b13614ab544320cd7e
size 3569153536

3
Haruhi-Zero-7B-0_3.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d241cab1eb138aadd1fcdb2c5ce7c3f7731f40786bccc8baa07c32c4b1d74ec6
size 4523173376

3
Haruhi-Zero-7B-0_3.i1-Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e184e06490f740757bf26ceb9ae5dc407d4bf1ee986f9f86a0ade1fcc8183b5b
size 4511901184

3
Haruhi-Zero-7B-0_3.i1-Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:91e95674cd749281395db5fd1b78c80610a085278ae5aeb15348ca2be402403d
size 4511901184

3
Haruhi-Zero-7B-0_3.i1-Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54d46da06dfcc94231ade1877361ef0f1bef20662f470338c4e8d2673f825875
size 4511901184

3
Haruhi-Zero-7B-0_3.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bf84c79f068b1838cac7c833b1d9636ed96cde854e9ac73e4ea3ce480acef8e
size 4899218944

3
Haruhi-Zero-7B-0_3.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:383d885ee0971b139f0b5570b27658052c76a1ac62fbc69cebb4a42daef91761
size 4534445568

3
Haruhi-Zero-7B-0_3.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0ced7651a828b1eca5a170920f7926c1ac49b067e10cce35ee905dd10d83d83
size 5708916224

3
Haruhi-Zero-7B-0_3.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e307d6eb39d97e7bdc89ec2a7019f2041022626177ac7730504149605008ca2d
size 5399193088

3
Haruhi-Zero-7B-0_3.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c4acc763d33ac2b509cc83ec844e4a0cede774272f5fa43c12bd37ee3ca0ad1
size 6341940736

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: silk-road/Haruhi-Zero-7B-0_3
datasets:
- silk-road/ChatHaruhi-Expand-118K
language:
- en
library_name: transformers
license: cc-by-4.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/silk-road/Haruhi-Zero-7B-0_3
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ1_M.gguf) | i1-IQ1_M | 2.2 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ2_S.gguf) | i1-IQ2_S | 2.8 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ3_S.gguf) | i1-IQ3_S | 3.7 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.7 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_0_4_4.gguf) | i1-Q4_0_4_4 | 4.6 | fast on arm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_0_4_8.gguf) | i1-Q4_0_4_8 | 4.6 | fast on arm+i8mm, low quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_0_8_8.gguf) | i1-Q4_0_8_8 | 4.6 | fast on arm+sve, low quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_0.gguf) | i1-Q4_0 | 4.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Haruhi-Zero-7B-0_3-i1-GGUF/resolve/main/Haruhi-Zero-7B-0_3.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a44e5a32b2631b1c02dba3f0587b0ca2ad778b77843b0a1ff9255c2d5f220e3
size 3511633