初始化项目,由ModelHub XC社区提供模型
Model: teddylee777/llama-3-8b-it-ko-chang-gguf Source: Original Platform
This commit is contained in:
55
README.md
Normal file
55
README.md
Normal file
@@ -0,0 +1,55 @@
|
||||
---
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
language:
|
||||
- ko
|
||||
---
|
||||
|
||||
- Original model is [lcw99/llama-3-8b-it-ko-chang](https://huggingface.co/lcw99/llama-3-8b-it-ko-chang)
|
||||
- Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
||||
|
||||
## Template (LM Studio)
|
||||
|
||||
```
|
||||
<|start_header_id|>system<|end_header_id|>
|
||||
{System}
|
||||
<|eot_id|>
|
||||
<|start_header_id|>B<|end_header_id|>
|
||||
{User}
|
||||
<|eot_id|><|start_header_id|>A<|end_header_id|>
|
||||
{Assistant}
|
||||
```
|
||||
|
||||
### LM Studio Demo
|
||||
|
||||

|
||||
|
||||
|
||||
## Ollama Template
|
||||
|
||||
```
|
||||
TEMPLATE """{{- if .System }}<|start_header_id|>system<|end_header_id|>
|
||||
{{ .System }}
|
||||
<|eot_id|>
|
||||
{{- end }}
|
||||
|
||||
<|start_header_id|>B<|end_header_id|>
|
||||
{{ .Prompt }}
|
||||
<|eot_id|>
|
||||
<|start_header_id|>A<|end_header_id|>
|
||||
"""
|
||||
```
|
||||
|
||||
### Ollama DEMO
|
||||
|
||||

|
||||
|
||||
## Stop Token
|
||||
|
||||
```
|
||||
<|eot_id|>
|
||||
<|start_header_id|>
|
||||
<|end_header_id|>
|
||||
<|begin_of_text|>
|
||||
<|end_of_text|>
|
||||
```
|
||||
Reference in New Issue
Block a user