mistral-3b-sft-prompt-hack-gguf/README.md

library_name, pipeline_tag, tags, base_model

library_name	pipeline_tag	tags	base_model
gguf	text-generation	gguf llama.cpp quantized text-generation	ozashu/mistral-3b-sft-prompt-hack-merged

mistral-3b-sft-prompt-hack-gguf

GGUF exports of the merged model.

Files:

• model-f16.gguf
• model-Q4_K_M.gguf

Run with llama.cpp

llama-cli -m model-Q4_K_M.gguf -p "こんにちは" -n 128