Update README.md
This commit is contained in:
@@ -15,6 +15,10 @@ Think step by step with a logical reasoning and intellectual sense before you pr
|
|||||||
|
|
||||||
- For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message.
|
- For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message.
|
||||||
|
|
||||||
|
- IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes.
|
||||||
|
There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3.
|
||||||
|
Until then, I suggest you run F16 or Q8 if possible.
|
||||||
|
|
||||||
GENERAL INFO:
|
GENERAL INFO:
|
||||||
---
|
---
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user