25 lines
535 B
Markdown
25 lines
535 B
Markdown
|
---
|
||
|
|
license: apache-2.0
|
||
|
|
datasets:
|
||
|
|
- HuggingFaceH4/ultrachat_200k
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
base_model: Locutusque/TinyMistral-248M-v2-Instruct
|
||
|
|
---
|
||
|
|
|
||
|
|
# Description
|
||
|
|
GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct).
|
||
|
|
|
||
|
|
# Recommended inference parameters
|
||
|
|
```
|
||
|
|
do_sample: true
|
||
|
|
temperature: 0.1
|
||
|
|
top_p: 0.14
|
||
|
|
top_k: 12
|
||
|
|
repetition_penalty: 1.1
|
||
|
|
```
|
||
|
|
|
||
|
|
# Recommended prompt template
|
||
|
|
```
|
||
|
|
<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|>
|
||
|
|
```
|