license, language, base_model, pipeline_tag, tags
license language base_model pipeline_tag tags
apache-2.0
en
allenai/Molmo2-4B
image-text-to-text
gguf
llama.cpp

Molmo2 GGUF

I won't be maintaining this model

An attempt at supporting Molmo2-4B on llama.cpp for personal use. This is a vibe coded solution so I am still benchmarking its actual performance and yet to determine best parameters. Language model on its own works fine, but seems to be increasingly lobotomized when mmproj is included. Vision modality in the mmproj requires custom modifications to llama.cpp mtmd code which I am optimizing.

Description
Model synced from source: reubk/Molmo2-4B-GGUF
Readme 24 KiB