初始化项目,由ModelHub XC社区提供模型
Model: BEncoderRT/medical_inference Source: Original Platform
This commit is contained in:
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
unsloth.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
108
README.md
Normal file
108
README.md
Normal file
@@ -0,0 +1,108 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
datasets:
|
||||
- FreedomIntelligence/medical-o1-reasoning-SFT
|
||||
language:
|
||||
- zh
|
||||
base_model:
|
||||
- unsloth/DeepSeek-R1-Distill-Llama-8B
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- unsloth
|
||||
- deepseek
|
||||
- rola
|
||||
- sft
|
||||
---
|
||||
|
||||
# DeepSeek-R1 Medical Reasoning Model
|
||||
|
||||
This repository contains a **fine-tuned medical reasoning model** based on
|
||||
[DeepSeek-R1-Distill-Llama-8B](https://huggingface.co/unsloth/DeepSeek-R1-Distill-Llama-8B)
|
||||
and trained on the [medical-o1-reasoning-SFT](https://huggingface.co/datasets/FreedomIntelligence/medical-o1-reasoning-SFT) dataset.
|
||||
|
||||
⚠️ **The uploaded file (`unsloth.Q8_0.gguf`) contains quantized weights** for efficient inference.
|
||||
|
||||
---
|
||||
|
||||
## 🔍 Model Overview
|
||||
|
||||
- **Base Model**: unsloth/DeepSeek-R1-Distill-Llama-8B
|
||||
- **Training Method**: SFT (Supervised Fine-Tuning)
|
||||
- **Domain**: Medical reasoning and clinical knowledge
|
||||
- **Language**: English
|
||||
- **Quantization**: Q8_0 (gguf format for efficient inference)
|
||||
|
||||
---
|
||||
|
||||
## 📚 Training Data
|
||||
|
||||
The model was fine-tuned on:
|
||||
|
||||
- **Dataset**: `FreedomIntelligence/medical-o1-reasoning-SFT`
|
||||
- **Language**: English
|
||||
- **Task**: Medical reasoning, clinical question-answering
|
||||
|
||||
---
|
||||
|
||||
## 🚀 Usage Example
|
||||
|
||||
> **Note:** The model is stored in `.gguf` format (quantized). You can load it using `unsloth` library.
|
||||
|
||||
```python
|
||||
from unsloth import FastLanguageModel
|
||||
import torch
|
||||
|
||||
# Load the quantized GGUF model
|
||||
model, tokenizer = FastLanguageModel.from_pretrained(
|
||||
"./unsloth.Q8_0.gguf",
|
||||
max_seq_length=2048,
|
||||
load_in_8bit=True, # optional depending on quantization
|
||||
)
|
||||
|
||||
FastLanguageModel.for_inference(model)
|
||||
|
||||
def generate(model, prompt, max_new_tokens=200):
|
||||
inputs = tokenizer(prompt, return_tensors="pt").to("cuda")
|
||||
|
||||
with torch.no_grad():
|
||||
outputs = model.generate(
|
||||
**inputs,
|
||||
max_new_tokens=max_new_tokens,
|
||||
do_sample=True,
|
||||
temperature=0.7,
|
||||
top_p=0.9,
|
||||
)
|
||||
|
||||
return tokenizer.decode(outputs[0], skip_special_tokens=True)
|
||||
|
||||
# Example prompt
|
||||
prompt = """### Instruction:
|
||||
"一个患有急性阑尾炎的病人已经发病5天,腹痛稍有减轻但仍然发热,在体检时发现右下腹有压痛的包块,此时应如何处理?"
|
||||
### Response:
|
||||
"""
|
||||
|
||||
print(generate(model, prompt))
|
||||
|
||||
|
||||
<think>
|
||||
这个病人已经有五天的急性阑尾炎了,腹痛虽然有所缓解,但他还是发烧,这让我有点担心。再看看他的体检结果,右下腹有压痛的包块,这就让我更有理由担心。嗯,既然有包块,而且病人还是发烧,应该是急性阑尾炎的急性症状。
|
||||
|
||||
想到这些,我觉得应该马上处理一下。最好的办法就是立即做腹部超声检查,看看包块的具体情况。超声检查可以帮助我们了解包块的位置、大小、形态以及周围组织的状态,这些信息对治疗非常重要。
|
||||
|
||||
哦,对了,包块如果是液体的,可能就不需要手术了。我们可以通过超声检查来确定这一点。这样就能避免不必要的手术创伤。
|
||||
|
||||
但是如果包块是固体的,特别是当它对周围组织有压迫作用时,手术就变得必要了。我们需要根据包块的具体情况来决定是否手术。
|
||||
|
||||
另外,包块的形态和位置也会影响手术的选择。我们需要根据这些因素来制定具体的手术方案。
|
||||
|
||||
嗯,总结一下,首先必须做一个腹部超声检查,确定包块的类型和具体情况。只有在确认包块是固体并且对周围组织有压迫作用的时候,才需要考虑手术。
|
||||
|
||||
好的,这个思路看起来很合理。现在就要把这些想法转化为具体的处理步骤。
|
||||
</think>
|
||||
在这种情况下,建议首先进行腹部超声检查,以确定包块的类型和具体情况。根据检查结果:
|
||||
|
||||
1. **如果包块是液体性包块**:通常不需要手术。可以通过药物治疗缓解症状,随后观察病情缓解情况。
|
||||
|
||||
2. **如果包块是固体性包块并且对周围组织有压迫作用**:这时手术就变得必要了。通常需要进行包块切除术,以解除压迫,缓解症状。
|
||||
|
||||
请尽快安排进行腹部超声检查,并根据检查结果制定最合适的手术方案。<|end▁of▁sentence|>
|
||||
3
config.json
Normal file
3
config.json
Normal file
@@ -0,0 +1,3 @@
|
||||
{
|
||||
"model_type": "llama"
|
||||
}
|
||||
3
unsloth.Q8_0.gguf
Normal file
3
unsloth.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1607e172a2bbd53ce28d5e87fb5135f067026b399b8962d8ed78a3eea4b5abb
|
||||
size 8540773152
|
||||
Reference in New Issue
Block a user