Update README.md

This commit is contained in:
Orenguteng
2024-08-10 16:54:10 +00:00
committed by system
parent 528e634ecb
commit 2340f8fbcd

View File

@@ -15,6 +15,10 @@ Think step by step with a logical reasoning and intellectual sense before you pr
- For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message. - For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message.
- IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes.
There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3.
Until then, I suggest you run F16 or Q8 if possible.
GENERAL INFO: GENERAL INFO:
--- ---