Model: joongi007/Ko-Qwen2-7B-Instruct-GGUF Source: Original Platform
license, base_model, tags, model-index
| license | base_model | tags | model-index | ||||||
|---|---|---|---|---|---|---|---|---|---|
| cc-by-nc-4.0 | spow12/Ko-Qwen2-7B-Instruct |
|
|
- Original model is spow12/Ko-Qwen2-7B-Instruct
- quantized using llama.cpp - b3510
<|im_start|>system
{System}<|im_end|>
<|im_start|>user
{User}<|im_end|>
<|im_start|>assistant
{Assistant}
"Flash Attention" function must be activated. why?
Description