mradermacher/QwenGuard-v1.2-7B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/QwenGuard-v1.2-7B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-26 02:46:16 +08:00
commit 613051a128
16 changed files with 183 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.mmproj-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.mmproj-f16.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.f16.gguf filter=lfs diff=lfs merge=lfs -text
QwenGuard-v1.2-7B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
QwenGuard-v1.2-7B.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c8fe34e9c802eebb5c47ede90bcaeb03bcbf025e718041af6990307ffb6fb58
size 4250299392

3
QwenGuard-v1.2-7B.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2afc23687d8bb2a22d5eb377f2b32decc131d1cfae8a34546468acc3061a7098
size 3015941120

3
QwenGuard-v1.2-7B.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e65c924e92aa6ef5c977027a66644efdf822c45970139ad0f18104fc47fc66c8
size 4088460288

3
QwenGuard-v1.2-7B.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3787937089155def377d50afd900499e944b13e1f929078ab83e18ffdeb74c8
size 3808392192

3
QwenGuard-v1.2-7B.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77e40abcaf0c658617d10cfcb704f992fb67ec882daf8d9e6aaa4788fa73e3d7
size 3492369408

3
QwenGuard-v1.2-7B.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c909286ea40004acd57e7c0bebf16ce7f0f1408b4f46f51049512673752696b3
size 4683074560

3
QwenGuard-v1.2-7B.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:881631f7671f5f752f9f47e1c0eb8665dc7c28adaf28ccc4cdb0044fee507b44
size 4457769984

3
QwenGuard-v1.2-7B.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb93557f64c6d527c7f52c1ec0b5e479f94bce794046492f0bac9d85f4c0e049
size 5444832256

3
QwenGuard-v1.2-7B.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96d44fe5c1ec4aee983851ab9cc4676ec8b53363a12b14b14afc713a3a2c1a5b
size 5315177472

3
QwenGuard-v1.2-7B.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b88ed2ba4784f542fb4078e1cfb9731eeb96ebd71ae0bc30a59fd38f1e832931
size 6254199808

3
QwenGuard-v1.2-7B.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0f99f33671ed5cf3588d37dcb89fe606a59df01fce6f701d2a7714f96fb5628
size 8098526208

3
QwenGuard-v1.2-7B.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:86385bcf9734423ce128e14dd98725428ecd353bb255f9537559e1b14a8ffe80
size 15237854208

3
QwenGuard-v1.2-7B.mmproj-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:47d08f0ee0710f08a9c662d0ba4307b918731ffbfc759232f2f7af605a3062f5
size 853120384

3
QwenGuard-v1.2-7B.mmproj-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6aa22d0c6d7f363a8a9dd4b2761638346b3c6a34c8e13fcee6a61175a791a15f
size 1354163584

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: AIML-TUDA/QwenGuard-v1.2-7B
datasets: AIML-TUDA/LlavaGuard
extra_gated_fields:
Affiliation: text
Country: text
Email: text
? I have explicitly checked that downloading LlavaGuard is legal in my jurisdiction,
in the country/region where I am located right now, and for the use case that
I have described above, I have also read and accepted the relevant Terms of Use
: checkbox
Name: text
extra_gated_prompt: By filling out the form below I understand that LlavaGuard is
a derivative model based on webscraped images and the SMID dataset that use individual
licenses and their respective terms and conditions apply. I understand that all
content uses are subject to the terms of use. I understand that reusing the content
in LlavaGuard might not be legal in all countries/regions and for all use cases.
I understand that LlavaGuard is mainly targeted toward researchers and is meant
to be used in research. LlavaGuard authors reserve the right to revoke my access
to this data. They reserve the right to modify this data at any time in accordance
with take-down requests.
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- llama-factory
- freeze
- generated_from_trainer
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/AIML-TUDA/QwenGuard-v1.2-7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#QwenGuard-v1.2-7B-GGUF).***
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.mmproj-Q8_0.gguf) | mmproj-Q8_0 | 1.0 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.mmproj-f16.gguf) | mmproj-f16 | 1.5 | multi-modal supplement |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q2_K.gguf) | Q2_K | 3.1 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q3_K_S.gguf) | Q3_K_S | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q3_K_M.gguf) | Q3_K_M | 3.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q3_K_L.gguf) | Q3_K_L | 4.2 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.IQ4_XS.gguf) | IQ4_XS | 4.4 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q4_K_S.gguf) | Q4_K_S | 4.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q4_K_M.gguf) | Q4_K_M | 4.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q5_K_S.gguf) | Q5_K_S | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q5_K_M.gguf) | Q5_K_M | 5.5 | |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q6_K.gguf) | Q6_K | 6.4 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.Q8_0.gguf) | Q8_0 | 8.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/QwenGuard-v1.2-7B-GGUF/resolve/main/QwenGuard-v1.2-7B.f16.gguf) | f16 | 15.3 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->