47 lines
694 B
Markdown
47 lines
694 B
Markdown
|
---
|
||
|
|
library_name: transformers
|
||
|
|
base_model:
|
||
|
|
- Qwen/Qwen3-4B-Instruct-2507
|
||
|
|
---
|
||
|
|
|
||
|
|
### Model Description
|
||
|
|
|
||
|
|
<!-- Provide a longer summary of what this model is. -->
|
||
|
|
|
||
|
|
- **Developed by:** InSeo Song
|
||
|
|
- **Finetuned from model:** Qwen/Qwen3-4B-Instruct-2507
|
||
|
|
|
||
|
|
|
||
|
|
## Evaluation
|
||
|
|
|
||
|
|
#### Metrics
|
||
|
|
|
||
|
|
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
||
|
|
|
||
|
|
PubMedQA: 63.40%
|
||
|
|
|
||
|
|
MedMCQA: 51.35%
|
||
|
|
|
||
|
|
MedQA: 60.01%
|
||
|
|
|
||
|
|
CareQA: 67.74%
|
||
|
|
|
||
|
|
Average: 60.62%
|
||
|
|
|
||
|
|
[You can see here](https://drive.google.com/drive/folders/1Z00t9tUAT1-nkTB5gdbfRZPg0qnS2mo4?usp=sharing)
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
#### Base Model(Qwen/Qwen3-4B-Instruct-2507) Metrics
|
||
|
|
|
||
|
|
PubMedQA: 40.60%
|
||
|
|
|
||
|
|
MedMCQA: 9.00%
|
||
|
|
|
||
|
|
MedQA: 14.84%
|
||
|
|
|
||
|
|
CareQA: 15.60%
|
||
|
|
|
||
|
|
Average: 20.01%
|