Update README.md
This commit is contained in:
@@ -103,7 +103,6 @@ VERSION 2 Update Notes:
|
|||||||
---
|
---
|
||||||
- More compliant
|
- More compliant
|
||||||
- Smarter
|
- Smarter
|
||||||
- Not fully evaluated, but scores higher on Winogrande compared to the original instruct model. 0.77901 vs 0.78848
|
|
||||||
- For best response, use this system prompt (feel free to expand upon it as you wish):
|
- For best response, use this system prompt (feel free to expand upon it as you wish):
|
||||||
|
|
||||||
Think step by step with a logical reasoning and intellectual sense before you provide any response.
|
Think step by step with a logical reasoning and intellectual sense before you provide any response.
|
||||||
@@ -114,6 +113,8 @@ Think step by step with a logical reasoning and intellectual sense before you pr
|
|||||||
There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3.
|
There seems to be some of the fine-tune loss happening due to the quantization. I will look into it for V3.
|
||||||
Until then, I suggest you run F16 or Q8 if possible.
|
Until then, I suggest you run F16 or Q8 if possible.
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
GENERAL INFO:
|
GENERAL INFO:
|
||||||
---
|
---
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user