From 2340f8fbcd2452125a798686ca90b882a08fb0d9 Mon Sep 17 00:00:00 2001 From: Orenguteng Date: Sat, 10 Aug 2024 16:54:10 +0000 Subject: [PATCH] Update README.md --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index 656b46b..c700374 100644 --- a/README.md +++ b/README.md @@ -15,6 +15,10 @@ Think step by step with a logical reasoning and intellectual sense before you pr - For more uncensored and compliant response, you can expand the system message differently, or simply enter a dot "." as system message. +- IMPORTANT: Upon further investigation, the Q4 seems to have refusal issues sometimes. +There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3. +Until then, I suggest you run F16 or Q8 if possible. + GENERAL INFO: ---