77 lines
2.3 KiB
Markdown
77 lines
2.3 KiB
Markdown
|
|
---
|
|
|
|
license: cc-by-nc-nd-4.0
|
|
language:
|
|
- en
|
|
library_name: transformers
|
|
pipeline_tag: text-generation
|
|
tags:
|
|
- llama
|
|
- mistral
|
|
- llama-2
|
|
- llama
|
|
- agi
|
|
- probelm solving
|
|
- biology
|
|
- reasoning
|
|
- llama3
|
|
- Dolus
|
|
|
|
---
|
|
|
|
|
|
|
|
# QuantFactory/Dolus-14b-Mini-GGUF
|
|
This is quantized version of [Cognitive-Machines-Labs/Dolus-14b-Mini](https://huggingface.co/Cognitive-Machines-Labs/Dolus-14b-Mini) created using llama.cpp
|
|
|
|
# Original Model Card
|
|
|
|
|
|
<h1 style="font-size: 36px;">Dolus-14b-Mini</h1>
|
|
|
|
<center>
|
|
<img src="https://cdn.prod.website-files.com/66a60c25748608d6d03809b8/66bc5c429e88c62f64491f57_00009-2074390737-p-500.png" alt="logo" width="18%" style="min-width:20px; display:block;">
|
|
</center>
|
|
|
|
**Ursidae-12b-Mini**
|
|
The little sister to Ursidae-300b,Dolus 14b Mini has been developed with a focus on complex multi-step chain of thought problem solving while still being deployable on edge systems. A model focused complex multi-step chain of thought problem solving while still being deployable on edge systems. Now better at reasoning!
|
|
|
|
|
|
## Main Goals:
|
|
|
|
Dolus was designed to address specific issues found in other chat models:
|
|
|
|
- Overcome limitations in logical reasoning found in other chat models.
|
|
- Efficiently solve complex, multi-step problems.
|
|
- Provide better decision-making assistance by enhancing the model's ability to reason and think critically.
|
|
- Removing restrictions and allowing the model to gain a true understanding of reality, greatly increasing overall results.
|
|
|
|
By focusing on these specific goals, the Ursidae-12b-Mini aims to provide a more sophisticated AI system that excels at critical thinking and problem-solving tasks requiring advanced logical reasoning skills. Its compact design makes it an efficient choice for applications where high cognitive abilities are necessary without occupying excessive computing resources.
|
|
|
|
# Recommended Settings:
|
|
|
|
**Defaults:**
|
|
|
|
```
|
|
min_p: 0.074
|
|
top_k: 40
|
|
repetition_penalty: 1.12
|
|
temp: 1.18
|
|
context: 8192
|
|
```
|
|
|
|
|
|
**Creative:**
|
|
|
|
```
|
|
min_p: 0.062
|
|
top_k: 40
|
|
repetition_penalty: 1.11
|
|
temp: 1.24
|
|
context: 8192
|
|
```
|
|
|
|
# Benchmarks:
|
|
PENDING FULL EVAL
|