From 0b19ad238a19f1280075e93f741160b065c6d6d8 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Fri, 25 Sep 2026 14:15:16 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf Source: Original Platform --- .gitattributes | 57 +++++++++++++ Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf | 3 + Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf | 3 + README.md | 118 +++++++++++++++++++++++++++ 24 files changed, 241 insertions(+) create mode 100644 .gitattributes create mode 100644 Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf create mode 100644 Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..325e8c5 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,57 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf b/Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf new file mode 100644 index 0000000..0f88a96 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:666d978b36bf49f5e447a7b10f68d571c6640825b28d32151047c000f4ad192e +size 4494615648 diff --git a/Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf b/Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf new file mode 100644 index 0000000..e1d9add --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb84eef2784172e3d8aa42a5bd439c4a5fec0fe333dd11d25225fbc6822f2679 +size 4337665120 diff --git a/Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf b/Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf new file mode 100644 index 0000000..1b751ff --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e26f944fbf215e092d3956eb1069b92a93bf235365832f35a8a79d9ebc0f5a9a +size 4144989280 diff --git a/Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf b/Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf new file mode 100644 index 0000000..141e7e3 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e453701c1c027a09da76dac84a253227352add77c77f5ff5c1b61c05e965bf87 +size 5475255392 diff --git a/Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf b/Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf new file mode 100644 index 0000000..a766d9f --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c501d23eb6ea6da51732bc81d6f314a6f9eb037a91a6e124e34a79b30b13ce1 +size 5223171168 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf new file mode 100644 index 0000000..e39860a --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d23f5c64f033d2bb34c138ee797102784774f24b4a586a52afd31ae571c53f2a +size 3805398112 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf new file mode 100644 index 0000000..f7b3e35 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b87dd809d610c100fef357497d6238a0fab6aa64cac0c430da124d187f23f09 +size 4761781344 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf new file mode 100644 index 0000000..959d7de --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:33c26804ce4c4d324564c3228a5376f5f8a9929e5cfe95e8657b7cccb9778ad5 +size 5132452960 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf new file mode 100644 index 0000000..f7b3e35 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7b87dd809d610c100fef357497d6238a0fab6aa64cac0c430da124d187f23f09 +size 4761781344 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf new file mode 100644 index 0000000..848129e --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61a8570707c6d66976788c8f72fc6d94447ba74bbe425a20a526537c5a17d089 +size 4337665120 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf new file mode 100644 index 0000000..e895612 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80c9277deb550a7f9b8312dda6ff73c5eeec48746190d6455887b5b9fd8a03dc +size 5443142752 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf new file mode 100644 index 0000000..cb588eb --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e1a4bd121873f556e62f5ba14cd5590a4e170879beb4f07017185c08b0d5b31 +size 5963367520 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf new file mode 100644 index 0000000..9863b4f --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07d9fe6ac20687e451716882ae344df53979c2e8224ec238ddf14af4594e1543 +size 5761057888 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf new file mode 100644 index 0000000..9863b4f --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07d9fe6ac20687e451716882ae344df53979c2e8224ec238ddf14af4594e1543 +size 5761057888 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf new file mode 100644 index 0000000..46371af --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ec01e9cc4aaadfa5fecb6444e036397efc2820875326454a5030c2d093e13df +size 5478925408 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf new file mode 100644 index 0000000..8160a1c --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:28e019c40c600c7895d53cdf1cbfa0a38cf4e9bcc92595732677bc3fdcd88653 +size 6483592288 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf new file mode 100644 index 0000000..96ccb59 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6a355a07abd3c8abeaa1443238eca48debe8f537a657efbe8396c565efb81b06 +size 7003817056 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf new file mode 100644 index 0000000..e942e1c --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd2c7adfb8d61816d08a9501e9720236057712160e208118759ff5d7ff219499 +size 6647366752 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf new file mode 100644 index 0000000..e942e1c --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd2c7adfb8d61816d08a9501e9720236057712160e208118759ff5d7ff219499 +size 6647366752 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf new file mode 100644 index 0000000..a0bea9a --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2b0e2b3993f4ffd59b0f57b6acf231837b32a08b0789a9e75f47fc016d20cc40 +size 6483592288 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf new file mode 100644 index 0000000..78a4066 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:259e5179c36c7f5b4554475960ba293610b24870094aaeadc20431030d367682 +size 7589069920 diff --git a/Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf b/Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf new file mode 100644 index 0000000..4dd0985 --- /dev/null +++ b/Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:af3e161c16edb3b2eae0623a5cb6ab45fef3b1a421eb321346f439e25eb8a147 +size 9827148896 diff --git a/README.md b/README.md new file mode 100644 index 0000000..bcaf259 --- /dev/null +++ b/README.md @@ -0,0 +1,118 @@ +Quantization made by Richard Erkhov. + +[Github](https://github.com/RichardErkhov) + +[Discord](https://discord.gg/pvy7H8DZMG) + +[Request more models](https://github.com/RichardErkhov/quant_request) + + +Gemma-2-9B-It-SPPO-Iter1 - GGUF +- Model creator: https://huggingface.co/UCLA-AGI/ +- Original model: https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter1/ + + +| Name | Quant method | Size | +| ---- | ---- | ---- | +| [Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q2_K.gguf) | Q2_K | 3.54GB | +| [Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.IQ3_XS.gguf) | IQ3_XS | 3.86GB | +| [Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.IQ3_S.gguf) | IQ3_S | 4.04GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q3_K_S.gguf) | Q3_K_S | 4.04GB | +| [Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.IQ3_M.gguf) | IQ3_M | 4.19GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q3_K.gguf) | Q3_K | 4.43GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q3_K_M.gguf) | Q3_K_M | 4.43GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q3_K_L.gguf) | Q3_K_L | 4.78GB | +| [Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.IQ4_XS.gguf) | IQ4_XS | 4.86GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q4_0.gguf) | Q4_0 | 5.07GB | +| [Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.IQ4_NL.gguf) | IQ4_NL | 5.1GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q4_K_S.gguf) | Q4_K_S | 5.1GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q4_K.gguf) | Q4_K | 5.37GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q4_K_M.gguf) | Q4_K_M | 5.37GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q4_1.gguf) | Q4_1 | 5.55GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q5_0.gguf) | Q5_0 | 6.04GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q5_K_S.gguf) | Q5_K_S | 6.04GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q5_K.gguf) | Q5_K | 6.19GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q5_K_M.gguf) | Q5_K_M | 6.19GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q5_1.gguf) | Q5_1 | 6.52GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q6_K.gguf) | Q6_K | 7.07GB | +| [Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf](https://huggingface.co/RichardErkhov/UCLA-AGI_-_Gemma-2-9B-It-SPPO-Iter1-gguf/blob/main/Gemma-2-9B-It-SPPO-Iter1.Q8_0.gguf) | Q8_0 | 9.15GB | + + + + +Original model description: +--- +license: gemma +datasets: +- openbmb/UltraFeedback +language: +- en +pipeline_tag: text-generation +--- +Self-Play Preference Optimization for Language Model Alignment (https://arxiv.org/abs/2405.00675) + +# Gemma-2-9B-It-SPPO-Iter1 + +This model was developed using [Self-Play Preference Optimization](https://arxiv.org/abs/2405.00675) at iteration 1, based on the [google/gemma-2-9b-it](https://huggingface.co/google/gemma-2-9b-it) architecture as starting point. We utilized the prompt sets from the [openbmb/UltraFeedback](https://huggingface.co/datasets/openbmb/UltraFeedback) dataset, splited to 3 parts for 3 iterations by [snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset](https://huggingface.co/datasets/snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset). All responses used are synthetic. + +**Terms of Use**: [Terms](https://www.kaggle.com/models/google/gemma/license/consent/verify/huggingface?returnModelRepoId=google/gemma-2-9b-it) + +## Links to Other Models +- [Gemma-2-9B-It-SPPO-Iter1](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter1) +- [Gemma-2-9B-It-SPPO-Iter2](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2) +- [Gemma-2-9B-It-SPPO-Iter3](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3) + +### Model Description + +- Model type: A 8B parameter GPT-like model fine-tuned on synthetic datasets. +- Language(s) (NLP): Primarily English +- License: Apache-2.0 +- Finetuned from model: google/gemma-2-9b-it + + +## [AlpacaEval Leaderboard Evaluation Results](https://tatsu-lab.github.io/alpaca_eval/) + + +| Model | LC. Win Rate | Win Rate | Avg. Length | +|-------------------------------------------|:------------:|:--------:|:-----------:| +|[Llama-3-8B-SPPO Iter1](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter1) |48.70 |40.76 | 1669 +|[Llama-3-8B-SPPO Iter2](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2) |50.93 | 44.64 | 1759 +|[Llama-3-8B-SPPO Iter3](https://huggingface.co/UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3) |**53.27** |**47.74** | 1803 + + + + + + +### Training hyperparameters +The following hyperparameters were used during training: + +- learning_rate: 5e-07 +- eta: 1000 +- per_device_train_batch_size: 8 +- gradient_accumulation_steps: 1 +- seed: 42 +- distributed_type: deepspeed_zero3 +- num_devices: 8 +- optimizer: RMSProp +- lr_scheduler_type: linear +- lr_scheduler_warmup_ratio: 0.1 +- num_train_epochs: 1.0 + + + + +## Citation +``` +@misc{wu2024self, + title={Self-Play Preference Optimization for Language Model Alignment}, + author={Wu, Yue and Sun, Zhiqing and Yuan, Huizhuo and Ji, Kaixuan and Yang, Yiming and Gu, Quanquan}, + year={2024}, + eprint={2405.00675}, + archivePrefix={arXiv}, + primaryClass={cs.LG} +} +``` + + +