25 lines
379 B
Markdown
25 lines
379 B
Markdown
---
|
|
library_name: gguf
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- gguf
|
|
- llama.cpp
|
|
- quantized
|
|
- text-generation
|
|
base_model: ozashu/mistral-3b-sft-prompt-hack-merged
|
|
---
|
|
|
|
# mistral-3b-sft-prompt-hack-gguf
|
|
|
|
GGUF exports of the merged model.
|
|
|
|
Files:
|
|
- `model-f16.gguf`
|
|
- `model-Q4_K_M.gguf`
|
|
|
|
## Run with llama.cpp
|
|
|
|
```bash
|
|
llama-cli -m model-Q4_K_M.gguf -p "こんにちは" -n 128
|
|
```
|