mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 08:13:16 +08:00
commit cd00b825b3
27 changed files with 222 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qwen-STEM-Specialist-7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Qwen-STEM-Specialist-7B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5f7daba3f23e309155416c56b27d17f8df0e6e6751465a03ce91001f3bb75ac
size 2042197248

3
Qwen-STEM-Specialist-7B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a68c3bce49fda8cd5c79046c5f0551299af0e5b0ef144b474f9d7f8df3b3afd4
size 1903668480

3
Qwen-STEM-Specialist-7B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0314a7af7a1bd661721d2703a2f64b20db4f3b0ffc2f3128ced10611dc31f93
size 2780343552

3
Qwen-STEM-Specialist-7B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:78fed890843a823f163385313609d263f01a30be3ee7274b07fd689ce48f1396
size 2595638528

3
Qwen-STEM-Specialist-7B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:55646e1f56e4caea9d041229e3af89d79e35af2dc539ed0dda12f5c4a392145f
size 2469022976

3
Qwen-STEM-Specialist-7B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8abba18a390f31899fd1849bdcd7b6f6b4e6654638eb9f9a7f8be93855f521a4
size 2273078528

3
Qwen-STEM-Specialist-7B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50a0b2ce761447fe12c102a58ff013b4179ecf7e4eee08a8a9c0ced1122ceba0
size 3574013184

3
Qwen-STEM-Specialist-7B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c7030f521752491b0146e2ee13f635af2df1c6efb6a55defd8f8edd4e76ccc6
size 3499193600

3
Qwen-STEM-Specialist-7B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:34fbd905415997acde8970a3e4596a84f148b30fb4ff3b328559da44e89eeaeb
size 3346257152

3
Qwen-STEM-Specialist-7B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9caff6b0fc0844d1070bca96e9a293a639a1889d7b56dc56ce4b99d0709f36ee
size 3114515712

3
Qwen-STEM-Specialist-7B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86c7545e5811d5632479650a04d75ec35d45c906a6501634305c495269e9533b
size 4437814528

3
Qwen-STEM-Specialist-7B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2cdbc2d76933ad686ef2e187ba6b98cb234f8f14cc3b53e12fa0cfd2477fe44
size 4218473728

3
Qwen-STEM-Specialist-7B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69d82c028b92dde997694618b8f5ab36c4f97e3d188f19deed103af4ae7cb2b4
size 3015941376

3
Qwen-STEM-Specialist-7B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ef2eeef712630793f715f8b9f7cb69fc5b694b38d1cb27935155afd9e7388fbe
size 2834074880

3
Qwen-STEM-Specialist-7B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a711c27f8e6f856a00a2d83f9c714dc9ee01d3b2a45368e3d8acba5d2552cb1
size 4088460544

3
Qwen-STEM-Specialist-7B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:185aa34db21d6a30c0ea600384683fe9ecca762f54478f9804e87afe5d9dafa5
size 3808392448

3
Qwen-STEM-Specialist-7B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49baae81ec5a68eaa4bf70dd175759f63ecf39db75f25bde6caa94e7b1f7cf15
size 3492369664

3
Qwen-STEM-Specialist-7B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4a7139475bcfaf22b12d8491d9fe863b87698b841a0cd630a2330fbbc37674c
size 4444122368

3
Qwen-STEM-Specialist-7B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9117eadea460920271cb4255892f2d9e0603f4f7e6189227b1eb42b081947ced
size 4873284864

3
Qwen-STEM-Specialist-7B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e152cd67b77a0164226c458973c722dfcfa3a99d7a43e13ba2f1103f9e6b7fd
size 4683074816

3
Qwen-STEM-Specialist-7B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bce9469454b893c7bbe36fd1d0f5e4f563d0034de61b1741376f3f6f062738d1
size 4457770240

3
Qwen-STEM-Specialist-7B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:adf309dee953fc3d16d2705587448011939a6dbc1ac665e1dd19857de89cca0a
size 5444832512

3
Qwen-STEM-Specialist-7B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86612198a561d25fdc34f01adc6d3cf1b0ff36031b69939005784bb7864b8d94
size 5315177728

3
Qwen-STEM-Specialist-7B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2d616846a0b81bc3525a1790da141c0c3bc731eb96b295b7052b0a3bb31edcac
size 6254200064

3
Qwen-STEM-Specialist-7B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d44cf7d127f02b8f9d2985b698d1c3337ec8bb7a803d92ff08a816bbfc024836
size 4560352

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
base_model: Anannta/Qwen-STEM-Specialist-7B
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Anannta/Qwen-STEM-Specialist-7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qwen-STEM-Specialist-7B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.1 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ2_M.gguf) | i1-IQ2_M | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.9 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q2_K.gguf) | i1-Q2_K | 3.1 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.7 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.9 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.3 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.5 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q4_0.gguf) | i1-Q4_0 | 4.5 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.6 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q4_1.gguf) | i1-Q4_1 | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qwen-STEM-Specialist-7B-i1-GGUF/resolve/main/Qwen-STEM-Specialist-7B.i1-Q6_K.gguf) | i1-Q6_K | 6.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->