42 lines
1.3 KiB
Markdown
42 lines
1.3 KiB
Markdown
---
|
|
license: other
|
|
license_name: exaone
|
|
license_link: https://huggingface.co/LGAI-EXAONE/EXAONE-Deep-2.4B/blob/main/LICENSE
|
|
language:
|
|
- ko
|
|
library_name: llama.cpp
|
|
tags:
|
|
- gguf
|
|
- exaone
|
|
- tagger
|
|
- float-right
|
|
---
|
|
|
|
# EXAONE-4.0-1.2B Float:Right Tagger (GGUF)
|
|
|
|
GGUF builds for **EXAONE-4.0-1.2B Float:Right Tagger**.
|
|
|
|
This model is tuned to output **tags as a JSON array** for short Korean text inputs.
|
|
|
|
non-GGUF : https://huggingface.co/FloatDo/exaone-4.0-1.2b-float-right-tagger
|
|
|
|
## Files
|
|
- `exaone-4.0-1.2b-float-right-tagger.f16.gguf` (FP16)
|
|
- `exaone-4.0-1.2b-float-right-tagger.Q8_0.gguf`
|
|
- `exaone-4.0-1.2b-float-right-tagger.Q4_K_M.gguf` ✅ recommended (often outputs clean tags with less extra text)
|
|
|
|
## Prompt format (llama.cpp)
|
|
Example:
|
|
|
|
```bash
|
|
llama-cli -m exaone-4.0-1.2b-float-right-tagger.Q4_K_M.gguf -n 96 -t 8 --temp 0 \
|
|
-p $'너는 태그 생성기다. 반드시 JSON 배열만 출력한다. 다른 글자 금지.\n\
|
|
규칙:\n- 태그 3~10개\n- 너무 디테일하지 않게(큰 주제)\n- 언더스코어(_) 금지\n\n\
|
|
문장:\n직장 상사가 계속 야근을 시켜서 스트레스 받는다. 퇴사 고민 중.\n\nassistant:\n'
|
|
```
|
|
Expected output (example):
|
|
```json
|
|
["직장","스트레스","퇴사","상사","일자리"]
|
|
```
|
|
Notes
|
|
• For stricter JSON-only behavior, use --temp 0 and keep -n small (64~96). |