初始化项目,由ModelHub XC社区提供模型
Model: wnkh/llava-med-v1.5-mistral-7b-hf Source: Original Platform
This commit is contained in:
39
README.md
Normal file
39
README.md
Normal file
@@ -0,0 +1,39 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model:
|
||||
- microsoft/llava-med-v1.5-mistral-7b
|
||||
- Eren-Senoglu/llava-med-v1.5-mistral-7b-hf
|
||||
tags:
|
||||
- medical
|
||||
- vision
|
||||
- llava-mistral
|
||||
- text-generation
|
||||
pipeline_tag: image-text-to-text
|
||||
---
|
||||
# 🧠 llava-med-v1.5-mistral-7b-hf
|
||||
|
||||
**HF-compatible conversion of [`microsoft/llava-med-v1.5-mistral-7b`](https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b)**
|
||||
✅ Now directly usable with [vLLM](https://github.com/vllm-project/vllm)
|
||||
|
||||
---
|
||||
|
||||
## 🔄 About This Model
|
||||
|
||||
This repository hosts a **Hugging Face Transformers-compatible** version of the [`microsoft/llava-med-v1.5-mistral-7b`](https://huggingface.co/microsoft/llava-med-v1.5-mistral-7b) model.
|
||||
|
||||
- **Original model**: Not directly usable with `vLLM` for faster inference.
|
||||
- **Eren-Senoglu/llava-med-v1.5-mistral-7b-hf model**: Good, but has bug currently
|
||||
- **This version**: Fully converted to the Hugging Face format and allows direct use of `vLLM`.
|
||||
|
||||
Thanks to this [PR](https://huggingface.co/Eren-Senoglu/llava-med-v1.5-mistral-7b-hf/discussions/1) under [Eren-Senoglu/llava-med-v1.5-mistral-7b-hf](https://huggingface.co/Eren-Senoglu/llava-med-v1.5-mistral-7b-hf) repo, I create this repo to have the fixed version.
|
||||
|
||||
All the contribution should go to [Eren-Senoglu](https://huggingface.co/Eren-Senoglu) and [xk-huang](https://huggingface.co/xk-huang)
|
||||
|
||||
## Usage
|
||||
```
|
||||
vllm serve wnkh/llava-med-v1.5-mistral-7b-hf
|
||||
```
|
||||
or
|
||||
```
|
||||
vllm serve wnkh/llava-med-v1.5-mistral-7b-hf --revision aeedceb
|
||||
```
|
||||
Reference in New Issue
Block a user