mradermacher/Qlora-lfm2-700m-mental-health-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Qlora-lfm2-700m-mental-health-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-17 15:44:17 +08:00
commit 33abea543b
14 changed files with 156 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Qlora-lfm2-700m-mental-health.f16.gguf filter=lfs diff=lfs merge=lfs -text

3
Qlora-lfm2-700m-mental-health.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:794173ed315063a9d584b745d831363b86023cc348b2ffe08ca23197d1f18c4d
size 429587232

3
Qlora-lfm2-700m-mental-health.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba0b84675d141ce442e71db71abe7ad7363cbfc7e956db8304756b8fd46eef2c
size 315087648

3
Qlora-lfm2-700m-mental-health.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6448959debe95ea8a9aa560adc03cae6e05d43e3e2ee2be8c9a465678ead2da8
size 409754400

3
Qlora-lfm2-700m-mental-health.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5897bd4fb3cd3d5369c89ac6ae99c7b97856f0b54740e95f50e107dedfe23b1b
size 387685152

3
Qlora-lfm2-700m-mental-health.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c732e9ecdc42676d7207f0cf65c5c4494d5bc58526ff01fe9a97ecb44a9cdc07
size 361093920

3
Qlora-lfm2-700m-mental-health.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94f3b30090e0832e5fe513b2b1edcf907f760d8c270a1af1e8c3c06d341ed0f2
size 468626208

3
Qlora-lfm2-700m-mental-health.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54bfe0f45de9c56305422b3d4a2b4d80c2cd4aba9c05fde09df3daa5e67b9a7d
size 449370912

3
Qlora-lfm2-700m-mental-health.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9160883c10be9911f1d8a5c2b39cc6dcc2e96bf55b5fc14de644dbc42a68f64d
size 538028832

3
Qlora-lfm2-700m-mental-health.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1e8807b0ebfdaa39bf1510f367bc2733bcdb0ad243699608ef5125a8732db01b
size 526539552

3
Qlora-lfm2-700m-mental-health.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b00d4b5926a8d87a4dd33fc1b1ea74a2d4fa24f4aebaa4d6226ca8ea238d6068
size 611769120

3
Qlora-lfm2-700m-mental-health.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c85e9ee5afae4b28c3e00ac03846b29f3a9673abdeaebd1974eeef89702f2cc
size 791567136

3
Qlora-lfm2-700m-mental-health.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85ca76d92f0514cbf7b1dcd78e75a5a52a8dab9d3b6ccb4bf05009ab6bb0b4d5
size 1487559456

73
README.md Normal file
View File

@@ -0,0 +1,73 @@
---
base_model: sirev/Qlora-lfm2-700m-mental-health
datasets:
- ShenLab/MentalChat16K
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
<!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
static quants of https://huggingface.co/sirev/Qlora-lfm2-700m-mental-health
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Qlora-lfm2-700m-mental-health-GGUF).***
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q2_K.gguf) | Q2_K | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q3_K_S.gguf) | Q3_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q3_K_M.gguf) | Q3_K_M | 0.5 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q3_K_L.gguf) | Q3_K_L | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.IQ4_XS.gguf) | IQ4_XS | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q4_K_S.gguf) | Q4_K_S | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q4_K_M.gguf) | Q4_K_M | 0.6 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q5_K_S.gguf) | Q5_K_S | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q5_K_M.gguf) | Q5_K_M | 0.6 | |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q6_K.gguf) | Q6_K | 0.7 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.Q8_0.gguf) | Q8_0 | 0.9 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/Qlora-lfm2-700m-mental-health-GGUF/resolve/main/Qlora-lfm2-700m-mental-health.f16.gguf) | f16 | 1.6 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->