初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b38da9a1d12c8aad0343236270478e92aea82c3553be16d8a72c6d8147f35414
|
||||||
|
size 2256145088
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dcb0838b993d2765d4abe67c9f11031fc829caee5d5dcf3aebefe892a8f997f6
|
||||||
|
size 2115766976
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ef11d87f5485404274f862172f4d735ca54cb0d3f272317bf1b591b6a3b16230
|
||||||
|
size 3051911872
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0d9c6273bd2e64bc8f2dc9c16f839d1259ee901966ec20b653bbde1d7a523149
|
||||||
|
size 2864741056
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XS.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:55f6c6022f02ff7958a7a841831a463278368d5dd4754ebbdcdc2f4acff74c6f
|
||||||
|
size 2696153792
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b62641b89891830a467c5e21f38e989f585962065aa77326d7813104079d0d99
|
||||||
|
size 2490108608
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:920dffd712598e63c88ab08377841c234e62a0c5a752b7c79fd440644a51a958
|
||||||
|
size 3896617664
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c6145d0760b7cb4a724ceacdc89b88f5b9cdeb87510f8879ba0b58ccb27b2771
|
||||||
|
size 3789662912
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XS.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6b23bae069aec3dbfe83886f70d1ea85f645e18080c894bb96a4f41f16d4e620
|
||||||
|
size 3626871488
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6d68ffd24901c663d29b5a71eb77ce929641e36a78e20fa05078d00900fa1ce1
|
||||||
|
size 3369630400
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_NL.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9c20fdd28367a6e1237f294aba3523ed58e2809c80eb69b4e7fe3a9a8e38fd26
|
||||||
|
size 4793621184
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_XS.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1e5b27eaf01b1bef293184406597e3c30c8c8bac0828b9691715ac6623ed046b
|
||||||
|
size 4561836736
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fd892498679c27352a32c375186ffda05ddc53135d5119b08ed0c43ac4e74fde
|
||||||
|
size 3281730240
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:885fad348e0da93c2c6bdb339ca4df835ac6bf8be7b0e6cd7937b202e443c802
|
||||||
|
size 3083549376
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_L.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d20a90afab6b7cefd958d2ec245ad75faad6aa309259183b3f3dc8a7cdfec24f
|
||||||
|
size 4431391424
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e46fe2e5b1f73933d8faf02cde411a5f96b233ef10db28b493ad302362dbf673
|
||||||
|
size 4124158656
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ab470f1b48ceb9e892746b1dbe99fe78d018d05e1fdef58822dcddf3c1ec1fc4
|
||||||
|
size 3769608896
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_0.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e716e4c473308852c2cea77a34cba5ac164bdb42c5031ff90f1cae69ce58f048
|
||||||
|
size 4787329728
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_1.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:aa18449592523a98259b1ced59bc753731fcd555d52a71ff057a77707df2dbff
|
||||||
|
size 5247752896
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:57fc4be5e4f6f0dc1751fa1c03d7d1e12b4352dbe657107a36ea852d45cf520d
|
||||||
|
size 5027781312
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a8eaba2b6ca616fa36d60c108d6e22c08bf23afee5df66ec587cf3057c1453af
|
||||||
|
size 4802009792
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_M.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:50954aee569dd2b6008c94cf516db020d4bc3ffdfb5d85cfc91d0aa3a6fb3a95
|
||||||
|
size 5851110080
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_S.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1b9e18a4a2299508af4558612abc7675d34606e9ac16071ac21afae688c42f08
|
||||||
|
size 5720758976
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q6_K.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b3fd2f132ac9d6f3ca5fa5fd1b1ab141dbd4a03cb3e9292dd740c68ea257e68d
|
||||||
|
size 6725896896
|
||||||
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.imatrix.gguf
Normal file
3
MathSmith-HC-Problem-Synthesizer-Qwen3-8B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f043f111ceee5f34bb507c47551c07aafd273c40fbf3473676035c9b0680d679
|
||||||
|
size 5347200
|
||||||
91
README.md
Normal file
91
README.md
Normal file
@@ -0,0 +1,91 @@
|
|||||||
|
---
|
||||||
|
base_model: Jasaxion/MathSmith-HC-Problem-Synthesizer-Qwen3-8B
|
||||||
|
datasets:
|
||||||
|
- Jasaxion/MathSmith-HC-Problems
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: transformers
|
||||||
|
license: apache-2.0
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- verl
|
||||||
|
- math
|
||||||
|
- synthetic-data
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/Jasaxion/MathSmith-HC-Problem-Synthesizer-Qwen3-8B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.2 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.4 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.6 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 3.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.2 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.2 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.4 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.5 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.9 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.9 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 4.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.2 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.5 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.7 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.9 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.9 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.9 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.1 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.3 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 6.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/MathSmith-HC-Problem-Synthesizer-Qwen3-8B-i1-GGUF/resolve/main/MathSmith-HC-Problem-Synthesizer-Qwen3-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.8 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user