mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 18:40:17 +08:00
commit fe67432d47
24 changed files with 200 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
gemma-2-9b-it-WPO-HB.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
base_model: wzhouad/gemma-2-9b-it-WPO-HB
datasets:
- wzhouad/gemma-2-ultrafeedback-hybrid
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- alignment-handbook
- gemma
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/wzhouad/gemma-2-9b-it-WPO-HB
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ1_S.gguf) | i1-IQ1_S | 2.5 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ1_M.gguf) | i1-IQ1_M | 2.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ2_XS.gguf) | i1-IQ2_XS | 3.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ2_S.gguf) | i1-IQ2_S | 3.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ2_M.gguf) | i1-IQ2_M | 3.5 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q2_K.gguf) | i1-Q2_K | 3.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ3_XS.gguf) | i1-IQ3_XS | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ3_S.gguf) | i1-IQ3_S | 4.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q3_K_S.gguf) | i1-Q3_K_S | 4.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ3_M.gguf) | i1-IQ3_M | 4.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q3_K_L.gguf) | i1-Q3_K_L | 5.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-IQ4_XS.gguf) | i1-IQ4_XS | 5.3 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q4_0.gguf) | i1-Q4_0 | 5.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q4_K_S.gguf) | i1-Q4_K_S | 5.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q5_K_S.gguf) | i1-Q5_K_S | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.7 | |
| [GGUF](https://huggingface.co/mradermacher/gemma-2-9b-it-WPO-HB-i1-GGUF/resolve/main/gemma-2-9b-it-WPO-HB.i1-Q6_K.gguf) | i1-Q6_K | 7.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
gemma-2-9b-it-WPO-HB.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98487c4a84c02441eead35be0984b2c3b76bb0ab7a9a2702c112ab2dfc9e6a79
size 2545952448

3
gemma-2-9b-it-WPO-HB.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a71eb0cc9e4ba7cdffaed698239d0e319e44005fa6ce07dcd4615a38c4f0307
size 2378565312

3
gemma-2-9b-it-WPO-HB.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff61c5f907725e981bb3a0db393513986aa48a24197f8b324e5a8fa54c2cc78c
size 3434669760

3
gemma-2-9b-it-WPO-HB.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15c6e30063b250fdf80c2ac4bacf404215132c6b4266182dd976e21539bed0fd
size 3211486912

3
gemma-2-9b-it-WPO-HB.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1fff01fc478167fe60bf3c2aa880c904ce1ddbb11b4f4d9a3bed5385bdeff8f
size 3067381440

3
gemma-2-9b-it-WPO-HB.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4b4990f41c0e89eaa74c9eca7f800247ca1825fcb94c41efdc2e1e3f27fe306
size 2824931008

3
gemma-2-9b-it-WPO-HB.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e667ca68878efa18dce42dd477be82e924952807f1a402293a040f34c81948a6
size 4494616256

3
gemma-2-9b-it-WPO-HB.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f83e76bfaae074d2884d57a0d8a4618d09477f81726a3a8d7d0b3b5114cf248
size 4337665728

3
gemma-2-9b-it-WPO-HB.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fde368fc50b870a8e241ef9eeec4745116bbf166ba630572f0417e32cc293027
size 4144989888

3
gemma-2-9b-it-WPO-HB.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:833adf882264ff0f6234f3a5d31a0e76c0b2d875b1baf111918e85fc46ebf1b0
size 3796739776

3
gemma-2-9b-it-WPO-HB.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:63cb7b91aa66466064d6038a80fa37c80f0f095c0defd6211e847862064bb1d6
size 5183030976

3
gemma-2-9b-it-WPO-HB.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da415795fcf9fb329003db51fa551341fa14f92516a9d5e58d947236446bde87
size 3805398720

3
gemma-2-9b-it-WPO-HB.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35928d2868e82596df0a102f8313f7290bbc5dd44d243595dcee868aa6ddf4cb
size 5132453568

3
gemma-2-9b-it-WPO-HB.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54ca00b4ab461ae5d510d0c606a510306365c05656254a3286047a3fad68ac7b
size 4761781952

3
gemma-2-9b-it-WPO-HB.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d86084012a4bc79de487b541df46444f83490186db9ef00a2ac7b0044b4cc92e
size 4337665728

3
gemma-2-9b-it-WPO-HB.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:39f73121d278ed43961eb3c4fd92277012be6b7cc89f3b24d81aff10084ac967
size 5459199680

3
gemma-2-9b-it-WPO-HB.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:48946f283dd212a496e137e825255d44f94d131512a9fe7475e8e17c8ab83b66
size 5761058496

3
gemma-2-9b-it-WPO-HB.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1982d496a87068e0a8e2f3e14cb5f957bdd45a3c52a7361f43454bf95dbb888a
size 5478926016

3
gemma-2-9b-it-WPO-HB.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81ae005667796719db151627619fe5213d5adee8fbbd6b971a5c9566916ac3dd
size 6647367360

3
gemma-2-9b-it-WPO-HB.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f01531470f6e6d938a2dd88baee93f8749f5bb54f8038055adcb6d0c2e194bae
size 6483592896

3
gemma-2-9b-it-WPO-HB.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f64bbfef0c388623109e27db4c6880d62cee3a7e28c08311951240a2567fb32f
size 7589070528

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56d7495fda33edb9a7b9d976c85d49046b6a9106db6552bc83399c02bfebf084
size 6116887