Files
Dolus-14b-Mini-GGUF/README.md
2024-09-14 01:51:52 +08:00

2.3 KiB


license: cc-by-nc-nd-4.0 language:

  • en library_name: transformers pipeline_tag: text-generation tags:
  • llama
  • mistral
  • llama-2
  • llama
  • agi
  • probelm solving
  • biology
  • reasoning
  • llama3
  • Dolus

QuantFactory/Dolus-14b-Mini-GGUF

This is quantized version of Cognitive-Machines-Labs/Dolus-14b-Mini created using llama.cpp

Original Model Card

Dolus-14b-Mini

logo

Ursidae-12b-Mini
The little sister to Ursidae-300b,Dolus 14b Mini has been developed with a focus on complex multi-step chain of thought problem solving while still being deployable on edge systems. A model focused complex multi-step chain of thought problem solving while still being deployable on edge systems. Now better at reasoning!

Main Goals:

Dolus was designed to address specific issues found in other chat models:

  • Overcome limitations in logical reasoning found in other chat models.
  • Efficiently solve complex, multi-step problems.
  • Provide better decision-making assistance by enhancing the model's ability to reason and think critically.
  • Removing restrictions and allowing the model to gain a true understanding of reality, greatly increasing overall results.

By focusing on these specific goals, the Ursidae-12b-Mini aims to provide a more sophisticated AI system that excels at critical thinking and problem-solving tasks requiring advanced logical reasoning skills. Its compact design makes it an efficient choice for applications where high cognitive abilities are necessary without occupying excessive computing resources.

Recommended Settings:

Defaults:

min_p: 0.074
top_k: 40
repetition_penalty: 1.12
temp: 1.18
context: 8192

Creative:

min_p: 0.062
top_k: 40
repetition_penalty: 1.11
temp: 1.24
context: 8192

Benchmarks:

PENDING FULL EVAL