commit 1706215b6f0d4563ccb3935692839b0532dd7af9 Author: ModelHub XC Date: Sun May 17 13:27:20 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..be12822 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,59 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +MS3.2-PaintedFantasy-v4-24B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_M.gguf new file mode 100644 index 0000000..d4b4290 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc60bf4c7046a3ee22f941dec5f48cd30f35c94a0e3836b8f9aa95f3bcb4280b +size 5750499392 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_S.gguf new file mode 100644 index 0000000..fa1e4b9 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ed192cf8b400b140a16e31b4600384b611b0173fd501b4f5476331b8e6eb4f92 +size 5273724992 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_M.gguf new file mode 100644 index 0000000..fe81cf0 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:67766473a128d4447511f44a90d21e98b09e4767407552b71bfcba292a18610f +size 8114055232 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_S.gguf new file mode 100644 index 0000000..2cc2a01 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:34c15e078ee739768eed402123ba218586256d469e0312e5737e47f078a5a4dc +size 7478356032 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XS.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..8f9b06e --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7d3b33d1bb04e19d6212d05fa71197e4bccc461a3dc7cde841758976d39dd570 +size 7207036992 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XXS.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..82c7b31 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c0fcb5695f72e4b6c0e955c713f920fe73393a610c87e349a5bf06b37dfa9d68 +size 6545123392 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_M.gguf new file mode 100644 index 0000000..b4f185c --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bbd9509f680830d4d12c29a29f41f90e5f93dcce1b38c8882a6479c8e9254226 +size 10650953792 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_S.gguf new file mode 100644 index 0000000..83e0e41 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4e947ae7bdd600ed263a01a9d2ae8c4b13d06e097a2a95a23bd65b5dc41d7fea +size 10428131392 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XS.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5824844 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:50df763c36eec752ff2a5eb2c164723079285d227d6edd4ce293d4887899c1e3 +size 9907120192 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XXS.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..e07c128 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cd9d86c967b59c47c982b9ca2c3f45548a7665b98037d6ced5d9d5cd692e1ab5 +size 9280596032 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-IQ4_XS.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..1ea4f95 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61b52a6a99152f4c830cfec315c7d97de6fc99535838b9fcea11c4b78b2ec2ea +size 12758919232 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K.gguf new file mode 100644 index 0000000..d1b4b7b --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:446d9ae22cb9a2b63642d569099322a528d5db63e32aab08504272092969d756 +size 8890329152 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..7bd0585 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fb70869b7f441bb34540da0282e6d5a8255c9fa934c8b9e9324ac1dcd57fbf3d +size 8320165952 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_L.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..47c955f --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e484f4de37cfe1089a0b90ea887c686231a2f5bca7a5e1dec4ee27e9bf34387c +size 12400764992 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..89be458 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa812cc94249899c40596484c05bacd1f0d0eb79c3869b3921ce8b333cb44bba +size 11474085952 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..90aa155 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c26aa1fe0df157d090591304dae7b0ffabd3faa7edcf53583a1cb7e02dc79cd5 +size 10400278592 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q4_0.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_0.gguf new file mode 100644 index 0000000..bbc5952 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d05e0603e2bbd08b8ecf18ad2ac6090b5b8cca458c38ea1b11be4ae1101a128f +size 13494233152 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q4_1.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_1.gguf new file mode 100644 index 0000000..5d4e089 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f69e5429103df9a6bbb297fcbc7c7a0fe473e06823ab9d899c578d55969ccd14 +size 14873110592 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..3ce0676 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:74744f64501d79df62ef53a990802dae0cbd8cd58dde4387b78e9ea84a0c37c8 +size 14333913152 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..0276287 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:396834c5eace729e62e983da4662f6bea7b8ad0137e6b984274c34126ae1fc2f +size 13549283392 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_M.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..c871e5f --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6ba792abf34779ee0056108cc504aaf18e2168a28d3f18833cffefa29a0d77f8 +size 16763988032 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_S.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..fdc0364 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5c6ec3496185ca750f2c1b8366ea9018e6434518ee0897f9811eee98aeaaa9a5 +size 16304416832 diff --git a/MS3.2-PaintedFantasy-v4-24B.i1-Q6_K.gguf b/MS3.2-PaintedFantasy-v4-24B.i1-Q6_K.gguf new file mode 100644 index 0000000..2c88434 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:caeef296a4cbe89c21ec5c050dd75272ba53f2cdf4b24bb06630c127b4912b31 +size 19345942592 diff --git a/MS3.2-PaintedFantasy-v4-24B.imatrix.gguf b/MS3.2-PaintedFantasy-v4-24B.imatrix.gguf new file mode 100644 index 0000000..f137130 --- /dev/null +++ b/MS3.2-PaintedFantasy-v4-24B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:866c8ec9bf5e88343208f1503501a228b94e17197fd9dc39df963d9f876b5f33 +size 10037312 diff --git a/README.md b/README.md new file mode 100644 index 0000000..fbea66d --- /dev/null +++ b/README.md @@ -0,0 +1,93 @@ +--- +base_model: zerofata/MS3.2-PaintedFantasy-v4-24B +datasets: +- zerofata/Instruct-Anime +- zerofata/Roleplay-Anime-Characters +- zerofata/Instruct-Anime-CreativeWriting +- zerofata/Summaries-Anime-FandomPages +- CyberNative/Code_Vulnerability_Security_DPO +- ConicCat/Wildchat-IF-Preference-Raw-MS3.2 +- ChaoticNeutrals/Reddit-NSFW-Writing_Prompts_ShareGPT +- jihuny/ultrafeedback_iterative_dpo_2048_iter5 +language: +- en +library_name: transformers +license: mit +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/zerofata/MS3.2-PaintedFantasy-v4-24B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MS3.2-PaintedFantasy-v4-24B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | | +| [GGUF](https://huggingface.co/mradermacher/MS3.2-PaintedFantasy-v4-24B-i1-GGUF/resolve/main/MS3.2-PaintedFantasy-v4-24B.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +