Model: wnkh/llava-med-v1.5-mistral-7b-hf Source: Original Platform
license, base_model, tags, pipeline_tag
| license | base_model | tags | pipeline_tag | ||||||
|---|---|---|---|---|---|---|---|---|---|
| apache-2.0 |
|
|
image-text-to-text |
🧠 llava-med-v1.5-mistral-7b-hf
HF-compatible conversion of microsoft/llava-med-v1.5-mistral-7b
✅ Now directly usable with vLLM
🔄 About This Model
This repository hosts a Hugging Face Transformers-compatible version of the microsoft/llava-med-v1.5-mistral-7b model.
- Original model: Not directly usable with
vLLMfor faster inference. - Eren-Senoglu/llava-med-v1.5-mistral-7b-hf model: Good, but has bug currently
- This version: Fully converted to the Hugging Face format and allows direct use of
vLLM.
Thanks to this PR under Eren-Senoglu/llava-med-v1.5-mistral-7b-hf repo, I create this repo to have the fixed version.
All the contribution should go to Eren-Senoglu and xk-huang
Usage
vllm serve wnkh/llava-med-v1.5-mistral-7b-hf
or
vllm serve wnkh/llava-med-v1.5-mistral-7b-hf --revision aeedceb
Description
Languages
Jinja
100%