diff --git a/README.md b/README.md index 656b46b..c700374 100644 --- a/README.md +++ b/README.md @@ -15,6 +15,10 @@ Think step by step with a logical reasoning and intellectual sense before you pr - For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message. +- IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes. +There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3. +Until then, I suggest you run F16 or Q8 if possible. + GENERAL INFO: ---