85 lines
1.8 KiB
Markdown
85 lines
1.8 KiB
Markdown
---
|
|
language:
|
|
- en
|
|
license: apache-2.0
|
|
tags:
|
|
- mental-health
|
|
- psychiatry
|
|
- psychology
|
|
- qwen3
|
|
- medical
|
|
- therapy
|
|
- gguf
|
|
base_model: Qwen/Qwen3-4B-Thinking-2507
|
|
library_name: transformers
|
|
pipeline_tag: text-generation
|
|
---
|
|
|
|
# Luna 1.0 - Psychiatric AI Companion
|
|
|
|
## Model Description
|
|
|
|
Luna is a 4B parameter psychiatric AI trained through 8-stage curriculum learning on Qwen3-4B-Thinking-2507. Created by Dr. Suvadeep.
|
|
|
|
**Training Stages:**
|
|
- Stage 1-2: Psychiatric knowledge (DSM-5, medications, CBT, counseling)
|
|
- Stage 3-7: Empathy & conversation skills (30,000+ dialogues)
|
|
- Stage 8: Identity & anti-refusal training
|
|
|
|
**Capabilities:**
|
|
- DSM-5/ICD-11 diagnoses
|
|
- Medication recommendations with dosages
|
|
- CBT/DBT/ACT psychotherapy
|
|
- Crisis support without deflection
|
|
- Empathetic conversation
|
|
|
|
## Files
|
|
|
|
| File | Size | Device |
|
|
|------|------|--------|
|
|
| model.safetensors | 8 GB | Training/fine-tuning |
|
|
| Luna-4B-thinking-Q4_K_M.gguf | 2.5 GB | GTX 1050 Ti |
|
|
| Luna-4B-thinking-Q3_K_M.gguf | 1.8 GB | iPhone 15 (recommended) |
|
|
| Luna-4B-thinking-Q2_K.gguf | 1.3 GB | iPhone 15 compact |
|
|
| Luna-4B-thinking-Q8_0.gguf | 4.5 GB | High-end GPUs |
|
|
|
|
## Usage
|
|
|
|
### iPhone 15
|
|
|
|
Download Q3_K_M.gguf, use with LM Studio iOS.
|
|
|
|
### Desktop (GTX 1050 Ti)
|
|
|
|
```python
|
|
from llama_cpp import Llama
|
|
|
|
llm = Llama(
|
|
model_path="Luna-4B-thinking-Q4_K_M.gguf",
|
|
n_ctx=2048,
|
|
n_gpu_layers=35
|
|
)
|
|
|
|
response = llm.create_chat_completion(
|
|
messages=[{"role": "user", "content": "I feel depressed"}],
|
|
max_tokens=1024
|
|
)
|
|
print(response["choices"][0]["message"]["content"])
|
|
```
|
|
|
|
## Training
|
|
|
|
- 8-stage curriculum learning
|
|
- LoRA (r=64, alpha=16)
|
|
- ~60,000 mental health conversations
|
|
- 20% replay buffers to prevent catastrophic forgetting
|
|
- Kaggle dual T4 GPUs
|
|
|
|
## Disclaimer
|
|
|
|
Research model only. Not a replacement for professional medical advice.
|
|
|
|
## License
|
|
|
|
Apache 2.0
|