初始化项目,由ModelHub XC社区提供模型
Model: hllzmz/medgemma-mentalist-gguf Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
medgemma-mentalist-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
medgemma-mentalist-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
medgemma-mentalist-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
77
README.md
Normal file
77
README.md
Normal file
@@ -0,0 +1,77 @@
|
|||||||
|
---
|
||||||
|
base_model:
|
||||||
|
- google/medgemma-27b-text-it
|
||||||
|
- unsloth/medgemma-27b-text-it
|
||||||
|
tags:
|
||||||
|
- text-generation-inference
|
||||||
|
- transformers
|
||||||
|
- unsloth
|
||||||
|
- gemma3_text
|
||||||
|
- trl
|
||||||
|
- llama.cpp
|
||||||
|
- mental-health
|
||||||
|
- psychology
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
datasets:
|
||||||
|
- hllzmz/synthetic-mental-health-convos
|
||||||
|
---
|
||||||
|
|
||||||
|
# MedGemma-27B Mentalist
|
||||||
|
|
||||||
|
GGUF quantizations for `medgemma-mentalist`.
|
||||||
|
|
||||||
|
- Base model: `unsloth/medgemma-27b-text-it`
|
||||||
|
- LoRA adapter: https://huggingface.co/hllzmz/medgemma-mentalist
|
||||||
|
- GGUF repo: https://huggingface.co/hllzmz/medgemma-mentalist-gguf
|
||||||
|
|
||||||
|
## Files (GGUF)
|
||||||
|
- `medgemma-mentalist-q4_k_m.gguf`
|
||||||
|
- `medgemma-mentalist-q5_k_m.gguf`
|
||||||
|
- `medgemma-mentalist-q8_0.gguf`
|
||||||
|
|
||||||
|
### Which quant should I use?
|
||||||
|
- **q4_k_m**: lowest RAM/VRAM usage, fastest, lowest quality among these.
|
||||||
|
- **q5_k_m**: best quality/speed/memory balance for most users.
|
||||||
|
- **q8_0**: highest quality (closest to bfloat16), largest file, needs most RAM/VRAM.
|
||||||
|
|
||||||
|
**MedGemma Mentalist** is a specialized **Mental Health Assistant** model fine-tuned on top of Google's `medgemma-27b`. It has been trained using with high-quality synthetic client-therapist dialogues.
|
||||||
|
|
||||||
|
This model is designed to understand users' emotional states, interpret described experiences through the lens of mental health and clinical standards, and provide supportive guidance using a warm, empathetic tone.
|
||||||
|
|
||||||
|
## Critical Disclaimer
|
||||||
|
**This model is NOT a licensed medical professional.**
|
||||||
|
|
||||||
|
* It **cannot** provide definitive medical diagnoses.
|
||||||
|
* It **cannot** prescribe medication.
|
||||||
|
* It **cannot** replace emergency services in crisis situations (e.g., suicide, self-harm, harm to others).
|
||||||
|
* **It is intended solely for educational, research, and preliminary informational purposes.**
|
||||||
|
|
||||||
|
## Model Capabilities
|
||||||
|
* **Empathetic Dialogue:** Listens to the user without judgement and validates their feelings (Active Listening).
|
||||||
|
* **Symptom Analysis:** correlates user-described experiences with clinical terminology and criteria.
|
||||||
|
* **Safety First:** Prioritizes safety planning and refers users to professional help when risk signals are detected.
|
||||||
|
|
||||||
|
## How to Use
|
||||||
|
|
||||||
|
This quantized models can be run with llama-cli, LM Studio or something that able to run gguf models. For optimal performance and role adherence, please strictly follow the recommended prompts and parameters below.
|
||||||
|
|
||||||
|
### Recommended System Prompt
|
||||||
|
```
|
||||||
|
SYSTEM_PROMPT = """
|
||||||
|
You are MedGemma Mentalist, an advanced AI mental health assistant designed to provide empathetic support, scientifically grounded psychoeducation, and guidance.
|
||||||
|
Your goal is to be a bridge to professional help and a source of reliable mental health information.
|
||||||
|
You should NEVER diagnose or stigmatize the user directly.
|
||||||
|
"""
|
||||||
|
```
|
||||||
|
|
||||||
|
### Recommended Parameters
|
||||||
|
To prevent the model from hallucinating or accidentally roleplaying as the client (User), the following generation settings are highly recommended:
|
||||||
|
|
||||||
|
Temperature: 0.3 - 0.5 (Lower values ensure the model remains objective and grounded in mental health knowledge).
|
||||||
|
|
||||||
|
Repetition Penalty: 1.1 (Prevents the model from getting stuck in loops).
|
||||||
|
|
||||||
|
|
||||||
|
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
|
||||||
3
medgemma-mentalist-q4_k_m.gguf
Normal file
3
medgemma-mentalist-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:aa86c499226aeb08316b4adbf82127fa78b08caf1af0dc2d21028ff807f14261
|
||||||
|
size 16546408864
|
||||||
3
medgemma-mentalist-q5_k_m.gguf
Normal file
3
medgemma-mentalist-q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:12a2a8eb70621c06487cda603100a0e67836014f65d6e7734d0e4cb2801259d0
|
||||||
|
size 19271395744
|
||||||
3
medgemma-mentalist-q8_0.gguf
Normal file
3
medgemma-mentalist-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c6444c305c0107f707bc09707c7223ad558b40e4685d4781bdc5550206af94a3
|
||||||
|
size 28707610304
|
||||||
Reference in New Issue
Block a user