18 lines
581 B
Markdown
18 lines
581 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
base_model:
|
||
|
|
- allenai/Molmo2-4B
|
||
|
|
pipeline_tag: image-text-to-text
|
||
|
|
tags:
|
||
|
|
- gguf
|
||
|
|
- llama.cpp
|
||
|
|
---
|
||
|
|
## Molmo2 GGUF
|
||
|
|
|
||
|
|
**I won't be maintaining this model**
|
||
|
|
|
||
|
|
An attempt at supporting Molmo2-4B on llama.cpp for personal use. This is a vibe coded solution so I am still benchmarking its actual performance and yet to determine best parameters.
|
||
|
|
Language model on its own works fine, but seems to be increasingly lobotomized when mmproj is included.
|
||
|
|
Vision modality in the mmproj requires custom modifications to llama.cpp mtmd code which I am optimizing.
|