Ko-Qwen2-7B-Instruct-GGUF/README.md

license, base_model, tags, model-index

license	base_model	tags	model-index
cc-by-nc-4.0	spow12/Ko-Qwen2-7B-Instruct	gguf	name results joongi007/Ko-Qwen2-7B-Instruct-GGUF

• Original model is spow12/Ko-Qwen2-7B-Instruct
• quantized using llama.cpp - b3510

<|im_start|>system
{System}<|im_end|>
<|im_start|>user
{User}<|im_end|>
<|im_start|>assistant
{Assistant}

"Flash Attention" function must be activated. why?