初始化项目,由ModelHub XC社区提供模型
Model: teddylee777/Qwen2.5-7B-Instruct-kowiki-qa-gguf Source: Original Platform
This commit is contained in:
46
README.md
Normal file
46
README.md
Normal file
@@ -0,0 +1,46 @@
|
||||
---
|
||||
language:
|
||||
- ko
|
||||
- en
|
||||
license: apache-2.0
|
||||
tags:
|
||||
- text-generation
|
||||
- qwen2.5
|
||||
- korean
|
||||
- instruct
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
## 📌 Notice
|
||||
- ✅ Original model is [beomi/Qwen2.5-7B-Instruct-kowiki-qa](https://huggingface.co/beomi/Qwen2.5-7B-Instruct-kowiki-qa)
|
||||
- ✅ Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
||||
|
||||
## 💬 Template
|
||||
|
||||
```
|
||||
FROM Qwen2.5-7B-Instruct-kowiki-qa-Q8_0.gguf
|
||||
|
||||
TEMPLATE """{{- if .System }}
|
||||
<|im_start|>system
|
||||
{{ .System }}
|
||||
<|im_end|>
|
||||
{{- end }}
|
||||
<|im_start|>user
|
||||
{{ .Prompt }}
|
||||
<|im_end|>
|
||||
<|im_start|>assistant
|
||||
"""
|
||||
|
||||
SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. 모든 대답은 한국어로 해주세요."""
|
||||
|
||||
PARAMETER temperature 0
|
||||
PARAMETER num_ctx 128000
|
||||
PARAMETER stop <|im_start|>
|
||||
PARAMETER stop <|im_end|>
|
||||
```
|
||||
|
||||
## 🧑💻 Helpful Contents
|
||||
- ✅ [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
|
||||
- ✅ [How to test llama3 by using Ollama](https://youtu.be/12CuUQIPdM4)
|
||||
- 🇰🇷 [LangChain Tutorial in Korean](https://wikidocs.net/book/14314)
|
||||
- 🔥 Please subscribe and support on [YouTube](https://www.youtube.com/@teddynote)
|
||||
Reference in New Issue
Block a user