初始化项目,由ModelHub XC社区提供模型

Model: teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-26 23:46:23 +08:00
commit f2900e660f
16 changed files with 303670 additions and 0 deletions

46
README.md Normal file
View File

@@ -0,0 +1,46 @@
---
language:
- ko
- en
license: apache-2.0
tags:
- text-generation
- qwen2.5
- korean
- instruct
pipeline_tag: text-generation
---
## 📌 Notice
- ✅ Original model is [beomi/Qwen2.5-7B-Instruct-kowiki-qa](https://huggingface.co/beomi/Qwen2.5-7B-Instruct-kowiki-qa)
- ✅ Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp)
## 💬 Template
```
FROM Qwen2.5-7B-Instruct-kowiki-qa-Q8_0.gguf
TEMPLATE """{{- if .System }}
<|im_start|>system
{{ .System }}
<|im_end|>
{{- end }}
<|im_start|>user
{{ .Prompt }}
<|im_end|>
<|im_start|>assistant
"""
SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. 모든 대답은 한국어로 해주세요."""
PARAMETER temperature 0
PARAMETER num_ctx 128000
PARAMETER stop <|im_start|>
PARAMETER stop <|im_end|>
```
## 🧑‍💻 Helpful Contents
- ✅ [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
- ✅ [How to test llama3 by using Ollama](https://youtu.be/12CuUQIPdM4)
- 🇰🇷 [LangChain Tutorial in Korean](https://wikidocs.net/book/14314)
- 🔥 Please subscribe and support on [YouTube](https://www.youtube.com/@teddynote)