55 lines
1.1 KiB
Markdown
55 lines
1.1 KiB
Markdown
---
|
|
library_name: transformers
|
|
license: apache-2.0
|
|
language:
|
|
- ko
|
|
---
|
|
|
|
- Original model is [lcw99/llama-3-8b-it-ko-chang](https://huggingface.co/lcw99/llama-3-8b-it-ko-chang)
|
|
- Quantized by [teddylee777](https://huggingface.co/teddylee777) by using [llama.cpp](https://github.com/ggerganov/llama.cpp)
|
|
|
|
## Template (LM Studio)
|
|
|
|
```
|
|
<|start_header_id|>system<|end_header_id|>
|
|
{System}
|
|
<|eot_id|>
|
|
<|start_header_id|>B<|end_header_id|>
|
|
{User}
|
|
<|eot_id|><|start_header_id|>A<|end_header_id|>
|
|
{Assistant}
|
|
```
|
|
|
|
### LM Studio Demo
|
|
|
|
|
|
|
|
|
|
## Ollama Template
|
|
|
|
```
|
|
TEMPLATE """{{- if .System }}<|start_header_id|>system<|end_header_id|>
|
|
{{ .System }}
|
|
<|eot_id|>
|
|
{{- end }}
|
|
|
|
<|start_header_id|>B<|end_header_id|>
|
|
{{ .Prompt }}
|
|
<|eot_id|>
|
|
<|start_header_id|>A<|end_header_id|>
|
|
"""
|
|
```
|
|
|
|
### Ollama DEMO
|
|
|
|
|
|
|
|
## Stop Token
|
|
|
|
```
|
|
<|eot_id|>
|
|
<|start_header_id|>
|
|
<|end_header_id|>
|
|
<|begin_of_text|>
|
|
<|end_of_text|>
|
|
``` |