From 3825ff58e6a53fd9d533136b46c1c42c897f69c7 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Thu, 14 May 2026 00:52:36 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: hllzmz/medgemma-mentalist-gguf Source: Original Platform --- .gitattributes | 38 +++++++++++++++++ README.md | 77 ++++++++++++++++++++++++++++++++++ medgemma-mentalist-q4_k_m.gguf | 3 ++ medgemma-mentalist-q5_k_m.gguf | 3 ++ medgemma-mentalist-q8_0.gguf | 3 ++ 5 files changed, 124 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 medgemma-mentalist-q4_k_m.gguf create mode 100644 medgemma-mentalist-q5_k_m.gguf create mode 100644 medgemma-mentalist-q8_0.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..646b314 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,38 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +medgemma-mentalist-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +medgemma-mentalist-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +medgemma-mentalist-q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..a7e487a --- /dev/null +++ b/README.md @@ -0,0 +1,77 @@ +--- +base_model: +- google/medgemma-27b-text-it +- unsloth/medgemma-27b-text-it +tags: +- text-generation-inference +- transformers +- unsloth +- gemma3_text +- trl +- llama.cpp +- mental-health +- psychology +license: apache-2.0 +language: +- en +datasets: +- hllzmz/synthetic-mental-health-convos +--- + +# MedGemma-27B Mentalist + +GGUF quantizations for `medgemma-mentalist`. + +- Base model: `unsloth/medgemma-27b-text-it` +- LoRA adapter: https://huggingface.co/hllzmz/medgemma-mentalist +- GGUF repo: https://huggingface.co/hllzmz/medgemma-mentalist-gguf + +## Files (GGUF) +- `medgemma-mentalist-q4_k_m.gguf` +- `medgemma-mentalist-q5_k_m.gguf` +- `medgemma-mentalist-q8_0.gguf` + +### Which quant should I use? +- **q4_k_m**: lowest RAM/VRAM usage, fastest, lowest quality among these. +- **q5_k_m**: best quality/speed/memory balance for most users. +- **q8_0**: highest quality (closest to bfloat16), largest file, needs most RAM/VRAM. + +**MedGemma Mentalist** is a specialized **Mental Health Assistant** model fine-tuned on top of Google's `medgemma-27b`. It has been trained using with high-quality synthetic client-therapist dialogues. + +This model is designed to understand users' emotional states, interpret described experiences through the lens of mental health and clinical standards, and provide supportive guidance using a warm, empathetic tone. + +## Critical Disclaimer +**This model is NOT a licensed medical professional.** + +* It **cannot** provide definitive medical diagnoses. +* It **cannot** prescribe medication. +* It **cannot** replace emergency services in crisis situations (e.g., suicide, self-harm, harm to others). +* **It is intended solely for educational, research, and preliminary informational purposes.** + +## Model Capabilities +* **Empathetic Dialogue:** Listens to the user without judgement and validates their feelings (Active Listening). +* **Symptom Analysis:** correlates user-described experiences with clinical terminology and criteria. +* **Safety First:** Prioritizes safety planning and refers users to professional help when risk signals are detected. + +## How to Use + +This quantized models can be run with llama-cli, LM Studio or something that able to run gguf models. For optimal performance and role adherence, please strictly follow the recommended prompts and parameters below. + +### Recommended System Prompt +``` +SYSTEM_PROMPT = """ + You are MedGemma Mentalist, an advanced AI mental health assistant designed to provide empathetic support, scientifically grounded psychoeducation, and guidance. + Your goal is to be a bridge to professional help and a source of reliable mental health information. + You should NEVER diagnose or stigmatize the user directly. + """ +``` + +### Recommended Parameters +To prevent the model from hallucinating or accidentally roleplaying as the client (User), the following generation settings are highly recommended: + +Temperature: 0.3 - 0.5 (Lower values ensure the model remains objective and grounded in mental health knowledge). + +Repetition Penalty: 1.1 (Prevents the model from getting stuck in loops). + + +[](https://github.com/unslothai/unsloth) \ No newline at end of file diff --git a/medgemma-mentalist-q4_k_m.gguf b/medgemma-mentalist-q4_k_m.gguf new file mode 100644 index 0000000..508dc9e --- /dev/null +++ b/medgemma-mentalist-q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa86c499226aeb08316b4adbf82127fa78b08caf1af0dc2d21028ff807f14261 +size 16546408864 diff --git a/medgemma-mentalist-q5_k_m.gguf b/medgemma-mentalist-q5_k_m.gguf new file mode 100644 index 0000000..6c4b0cf --- /dev/null +++ b/medgemma-mentalist-q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12a2a8eb70621c06487cda603100a0e67836014f65d6e7734d0e4cb2801259d0 +size 19271395744 diff --git a/medgemma-mentalist-q8_0.gguf b/medgemma-mentalist-q8_0.gguf new file mode 100644 index 0000000..bcf493e --- /dev/null +++ b/medgemma-mentalist-q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c6444c305c0107f707bc09707c7223ad558b40e4685d4781bdc5550206af94a3 +size 28707610304