32 lines
830 B
Plaintext
32 lines
830 B
Plaintext
|
FROM ./qwen3-4b.Q5_K_M.gguf
|
||
|
|
|
||
|
|
# Qwen3 chat template
|
||
|
|
TEMPLATE """<|im_start|>system
|
||
|
|
You are a financial sentiment analyst. Analyze the given financial text and provide:
|
||
|
|
1. Your reasoning in <reasoning> tags
|
||
|
|
2. Your sentiment classification (positive, negative, or neutral) in <answer> tags
|
||
|
|
|
||
|
|
Always use this exact format:
|
||
|
|
<reasoning>
|
||
|
|
[Your step-by-step analysis]
|
||
|
|
</reasoning>
|
||
|
|
<answer>[positive/negative/neutral]</answer><|im_end|>
|
||
|
|
<|im_start|>user
|
||
|
|
{{ .Prompt }}<|im_end|>
|
||
|
|
<|im_start|>assistant
|
||
|
|
"""
|
||
|
|
|
||
|
|
# Critical stop tokens to prevent infinite loops
|
||
|
|
PARAMETER stop "<|im_end|>"
|
||
|
|
PARAMETER stop "</answer>"
|
||
|
|
PARAMETER stop "<|endoftext|>"
|
||
|
|
PARAMETER stop "<|im_start|>"
|
||
|
|
|
||
|
|
# Generation parameters
|
||
|
|
PARAMETER temperature 0.3
|
||
|
|
PARAMETER top_p 0.9
|
||
|
|
PARAMETER top_k 40
|
||
|
|
PARAMETER repeat_penalty 1.15
|
||
|
|
PARAMETER num_ctx 1024
|
||
|
|
PARAMETER num_predict 300
|