mradermacher/MS3.2-24b-Angel-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/MS3.2-24b-Angel-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-18 04:22:54 +08:00
commit 22730fcc9e
26 changed files with 236 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
MS3.2-24b-Angel.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
MS3.2-24b-Angel.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26330fc597d3d35e131d650e3f1452eb40cd59770795503f70f200c98eaa372b
size 5750501600

3
MS3.2-24b-Angel.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:52a806aabf8596648617840f164181391de599c9ef14efbae92e238a5cc0e25c
size 5273727200

3
MS3.2-24b-Angel.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:71c53cba1ca8df43de191274ba5e1c17ade8304ac8d525e14155ac87333a110d
size 8114057440

3
MS3.2-24b-Angel.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:244f728452e5fca2b07c479f02721583b8ebda78a0af023bceab2b5781219247
size 7478358240

3
MS3.2-24b-Angel.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fdd9592d5494c1b96a6f6562c376f65f279ba17bef754a323987dca1989bc8a3
size 7207039200

3
MS3.2-24b-Angel.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84e5e236a863493a11f1bbe8fef12a5a03242861bddb3f2c6b05f9bfcb9e9542
size 6545125600

3
MS3.2-24b-Angel.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:149ce3dff4892d5ffbbdec2743972a6487498ad6a4a95d8a5ef96e72360b6dab
size 10650956000

3
MS3.2-24b-Angel.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0747c1b3ab0a9e6e0fa75fa8d9aac937d2bd6b3e72b5031aeb6a7dc3bbf0c16c
size 10428133600

3
MS3.2-24b-Angel.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1b89680270cfc89dbe352cece306da2ac52d6618a58cad332b2d7b261b9a393
size 9907122400

3
MS3.2-24b-Angel.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:922e782a64b97f55a051a4b58c3354db752af2e6ac6e2a74ad4dcf72d2966f44
size 9280598240

3
MS3.2-24b-Angel.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3aa0ef34ead28f47a8a2464eb0cbc8ff4feebe6cac7bcec7d5497bddde5e9e39
size 12758921440

3
MS3.2-24b-Angel.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c52ddda33052275d0a77b9d4d494b3df8eac71bcfe343e333b149d5888c2a1ed
size 8890331360

3
MS3.2-24b-Angel.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b364ec1f72409f0a5f91c85023395bda076b57a2551104168de8640d13bfce7
size 8320168160

3
MS3.2-24b-Angel.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dc15fef02c3f17ba82d2a445fb45ac0622bf47d2f9be9d348e5f00cf4959f1d0
size 12400767200

3
MS3.2-24b-Angel.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:44b74f2e69263c2cda76e736565f3e585e4475dd4f5a476359890151e74d4f9e
size 11474088160

3
MS3.2-24b-Angel.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e581676dc4ca6a8c4e7d73257f169b8ad1348712f9fa9ae845801d71f5f083ec
size 10400280800

3
MS3.2-24b-Angel.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:657142831bdcddc3ffd1c54de41b3379e220f6ddd6a05e50bbcb7788aa51aebd
size 13494235360

3
MS3.2-24b-Angel.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bf18b70bfecc1745a18a40b9f292ddad6a1d2ed7c8834d39244ff7b620376dac
size 14873112800

3
MS3.2-24b-Angel.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb668c4ff47cbc1d19c46c283b2770d148da565ecccdb31e82b6e61a05915f9b
size 14333915360

3
MS3.2-24b-Angel.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cb70b82e43b3c6e26a795f7ef45809055da51641c37b19174b79a8ee014574ba
size 13549285600

3
MS3.2-24b-Angel.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e7568cbc062c1e76a7bc492b2133f408714792a854559d22a7459f89bfcfc93
size 16763990240

3
MS3.2-24b-Angel.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:985642ae9a579d108dd170536e7ef52dedea54c39aff5c7c62b768d37a1724e5
size 16304419040

3
MS3.2-24b-Angel.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3f4dbdf6c7ced27780675de7845935ddad06e7a315d96a4396cca2ae0f9b5d9
size 19345944800

105
README.md Normal file
View File

@@ -0,0 +1,105 @@
---
base_model: allura-org/MS3.2-24b-Angel
datasets:
- PygmalionAI/PIPPA
- Alfitaria/nemotron-ultra-reasoning-synthkink
- PocketDoc/Dans-Prosemaxx-Gutenberg
- FreedomIntelligence/Medical-R1-Distill-Data
- cognitivecomputations/SystemChat-2.0
- allenai/tulu-3-sft-personas-instruction-following
- kalomaze/Opus_Instruct_25k
- simplescaling/s1K-claude-3-7-sonnet
- ai2-adapt-dev/flan_v2_converted
- grimulkan/theory-of-mind
- grimulkan/physical-reasoning
- nvidia/HelpSteer3
- nbeerbower/gutenberg2-dpo
- nbeerbower/gutenberg-moderne-dpo
- nbeerbower/Purpura-DPO
- antiven0m/physical-reasoning-dpo
- allenai/tulu-3-IF-augmented-on-policy-70b
- allenai/href
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- axolotl
- unsloth
- roleplay
- conversational
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/allura-org/MS3.2-24b-Angel
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MS3.2-24b-Angel-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/MS3.2-24b-Angel-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/MS3.2-24b-Angel-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
| [GGUF](https://huggingface.co/mradermacher/MS3.2-24b-Angel-i1-GGUF/resolve/main/MS3.2-24b-Angel.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c02db46d66a2ff252f35fc6a6b0a4ee45b9daf42ee28de44b27228ce1f91bb89
size 10003525