diff --git a/.gitattributes b/.gitattributes index b7e9e3a..904e0ab 100644 --- a/.gitattributes +++ b/.gitattributes @@ -1,37 +1,49 @@ *.7z filter=lfs diff=lfs merge=lfs -text *.arrow filter=lfs diff=lfs merge=lfs -text *.bin filter=lfs diff=lfs merge=lfs -text -*.bin.* filter=lfs diff=lfs merge=lfs -text *.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text *.ftz filter=lfs diff=lfs merge=lfs -text *.gz filter=lfs diff=lfs merge=lfs -text *.h5 filter=lfs diff=lfs merge=lfs -text *.joblib filter=lfs diff=lfs merge=lfs -text *.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text *.model filter=lfs diff=lfs merge=lfs -text *.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text *.onnx filter=lfs diff=lfs merge=lfs -text *.ot filter=lfs diff=lfs merge=lfs -text *.parquet filter=lfs diff=lfs merge=lfs -text *.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text *.pt filter=lfs diff=lfs merge=lfs -text *.pth filter=lfs diff=lfs merge=lfs -text *.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text saved_model/**/* filter=lfs diff=lfs merge=lfs -text *.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text *.tflite filter=lfs diff=lfs merge=lfs -text *.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text *.xz filter=lfs diff=lfs merge=lfs -text *.zip filter=lfs diff=lfs merge=lfs -text -*.zstandard filter=lfs diff=lfs merge=lfs -text -*.tfevents* filter=lfs diff=lfs merge=lfs -text -*.db* filter=lfs diff=lfs merge=lfs -text -*.ark* filter=lfs diff=lfs merge=lfs -text -**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text -**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text -**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text -*.safetensors filter=lfs diff=lfs merge=lfs -text -*.ckpt filter=lfs diff=lfs merge=lfs -text -*.gguf* filter=lfs diff=lfs merge=lfs -text -*.ggml filter=lfs diff=lfs merge=lfs -text -*.llamafile* filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Dolus-14b-Mini.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Dolus-14b-Mini.Q2_K.gguf b/Dolus-14b-Mini.Q2_K.gguf new file mode 100644 index 0000000..380d29f --- /dev/null +++ b/Dolus-14b-Mini.Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:664e1dff739d9c14227045d27b22a8fa099c458fd4e4e43439fabefbc5a50f89 +size 4463121600 diff --git a/Dolus-14b-Mini.Q3_K_L.gguf b/Dolus-14b-Mini.Q3_K_L.gguf new file mode 100644 index 0000000..ece0e73 --- /dev/null +++ b/Dolus-14b-Mini.Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6ae4e07636672e70d9e7dd464b8b3b2ffe2bfa29f770ef2085c95144c3cdc5c +size 6150681792 diff --git a/Dolus-14b-Mini.Q3_K_M.gguf b/Dolus-14b-Mini.Q3_K_M.gguf new file mode 100644 index 0000000..c8e3942 --- /dev/null +++ b/Dolus-14b-Mini.Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:85cb5443adc2357eeab83d94758e19f097194ce1201759705f333287c3c50e83 +size 5695599808 diff --git a/Dolus-14b-Mini.Q3_K_S.gguf b/Dolus-14b-Mini.Q3_K_S.gguf new file mode 100644 index 0000000..bc48713 --- /dev/null +++ b/Dolus-14b-Mini.Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d2ad38896f7c8edb4a0a6ef5a029df0869b9f4c5c8afdafe65d7404dc9449efb +size 5164496064 diff --git a/Dolus-14b-Mini.Q4_0.gguf b/Dolus-14b-Mini.Q4_0.gguf new file mode 100644 index 0000000..c9e207f --- /dev/null +++ b/Dolus-14b-Mini.Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5e02c3f1a1201150e4c8d90433c957d2aff64fd37992831c7b48f40ddf91b7b3 +size 6624679104 diff --git a/Dolus-14b-Mini.Q4_1.gguf b/Dolus-14b-Mini.Q4_1.gguf new file mode 100644 index 0000000..8602a33 --- /dev/null +++ b/Dolus-14b-Mini.Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:96b0b80acb0e6de702cd08a12707f027df7c172c16abefa3f76f94a1efb4449a +size 7311824064 diff --git a/Dolus-14b-Mini.Q4_K_M.gguf b/Dolus-14b-Mini.Q4_K_M.gguf new file mode 100644 index 0000000..d7e25b0 --- /dev/null +++ b/Dolus-14b-Mini.Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5bbe704ef94fa2e0443011063b314dcc4626de93e0793303e2ddcec9fdec60df +size 7013962944 diff --git a/Dolus-14b-Mini.Q4_K_S.gguf b/Dolus-14b-Mini.Q4_K_S.gguf new file mode 100644 index 0000000..3943831 --- /dev/null +++ b/Dolus-14b-Mini.Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fa3a176dc5344c8a3b77deb26858772d887172691081d1a41bca95b1ae53679d +size 6670816448 diff --git a/Dolus-14b-Mini.Q5_0.gguf b/Dolus-14b-Mini.Q5_0.gguf new file mode 100644 index 0000000..cd47a20 --- /dev/null +++ b/Dolus-14b-Mini.Q5_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2ed23e23d146a2596dfe07417bd3d146852e9052f342997370f7928dfda60d25 +size 7998969024 diff --git a/Dolus-14b-Mini.Q5_1.gguf b/Dolus-14b-Mini.Q5_1.gguf new file mode 100644 index 0000000..ff0e16a --- /dev/null +++ b/Dolus-14b-Mini.Q5_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e170fc48f8edd650056b53afba2e0d5e1c821d0cba0f59aab5120b002521c062 +size 8686113984 diff --git a/Dolus-14b-Mini.Q5_K_M.gguf b/Dolus-14b-Mini.Q5_K_M.gguf new file mode 100644 index 0000000..78da5af --- /dev/null +++ b/Dolus-14b-Mini.Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:37e6d267a2197ed0f11fdcd10c43dd09a5d1586eb1db7174c5551d08a8cc5ab5 +size 8199509184 diff --git a/Dolus-14b-Mini.Q5_K_S.gguf b/Dolus-14b-Mini.Q5_K_S.gguf new file mode 100644 index 0000000..55bd21e --- /dev/null +++ b/Dolus-14b-Mini.Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:94a0db15f3998a5de8c652fc56e94456067fa15d5882a129882c2d2d025faa22 +size 7998969024 diff --git a/Dolus-14b-Mini.Q6_K.gguf b/Dolus-14b-Mini.Q6_K.gguf new file mode 100644 index 0000000..0db6e3e --- /dev/null +++ b/Dolus-14b-Mini.Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:44cbbfab5e640754105b0253ef57091b246aee776a04ab87f39ab58425c0b87a +size 9459152064 diff --git a/Dolus-14b-Mini.Q8_0.gguf b/Dolus-14b-Mini.Q8_0.gguf new file mode 100644 index 0000000..84e0a5c --- /dev/null +++ b/Dolus-14b-Mini.Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bca5d5f39788a93e7d6958f3676fb2d2eb4e0b022d2b209e32125c07a628a31f +size 12249068736 diff --git a/README.md b/README.md index fa6eaa2..e4900af 100644 --- a/README.md +++ b/README.md @@ -1,47 +1,76 @@ + --- -license: Apache License 2.0 -#model-type: -##如 gpt、phi、llama、chatglm、baichuan 等 -#- gpt +license: cc-by-nc-nd-4.0 +language: +- en +library_name: transformers +pipeline_tag: text-generation +tags: +- llama +- mistral +- llama-2 +- llama +- agi +- probelm solving +- biology +- reasoning +- llama3 +- Dolus -#domain: -##如 nlp、cv、audio、multi-modal -#- nlp - -#language: -##语言代码列表 https://help.aliyun.com/document_detail/215387.html?spm=a2c4g.11186623.0.0.9f8d7467kni6Aa -#- cn - -#metrics: -##如 CIDEr、Blue、ROUGE 等 -#- CIDEr - -#tags: -##各种自定义,包括 pretrained、fine-tuned、instruction-tuned、RL-tuned 等训练方法和其他 -#- pretrained - -#tools: -##如 vllm、fastchat、llamacpp、AdaSeq 等 -#- vllm --- -### 当前模型的贡献者未提供更加详细的模型介绍。模型文件和权重,可浏览“模型文件”页面获取。 -#### 您可以通过如下git clone命令,或者ModelScope SDK来下载模型 -SDK下载 -```bash -#安装ModelScope -pip install modelscope +![](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ) + +# QuantFactory/Dolus-14b-Mini-GGUF +This is quantized version of [Cognitive-Machines-Labs/Dolus-14b-Mini](https://huggingface.co/Cognitive-Machines-Labs/Dolus-14b-Mini) created using llama.cpp + +# Original Model Card + + +

Dolus-14b-Mini

+ +
+ logo +
+ +**Ursidae-12b-Mini** +The little sister to Ursidae-300b,Dolus 14b Mini has been developed with a focus on complex multi-step chain of thought problem solving while still being deployable on edge systems. A model focused complex multi-step chain of thought problem solving while still being deployable on edge systems. Now better at reasoning! + + +## Main Goals: + +Dolus was designed to address specific issues found in other chat models: + +- Overcome limitations in logical reasoning found in other chat models. +- Efficiently solve complex, multi-step problems. +- Provide better decision-making assistance by enhancing the model's ability to reason and think critically. +- Removing restrictions and allowing the model to gain a true understanding of reality, greatly increasing overall results. + +By focusing on these specific goals, the Ursidae-12b-Mini aims to provide a more sophisticated AI system that excels at critical thinking and problem-solving tasks requiring advanced logical reasoning skills. Its compact design makes it an efficient choice for applications where high cognitive abilities are necessary without occupying excessive computing resources. + +# Recommended Settings: + +**Defaults:** + ``` -```python -#SDK模型下载 -from modelscope import snapshot_download -model_dir = snapshot_download('QuantFactory/Dolus-14b-Mini-GGUF') -``` -Git下载 -``` -#Git模型下载 -git clone https://www.modelscope.cn/QuantFactory/Dolus-14b-Mini-GGUF.git +min_p: 0.074 +top_k: 40 +repetition_penalty: 1.12 +temp: 1.18 +context: 8192 ``` -

如果您是本模型的贡献者,我们邀请您根据模型贡献文档,及时完善模型卡片内容。

\ No newline at end of file + +**Creative:** + +``` +min_p: 0.062 +top_k: 40 +repetition_penalty: 1.11 +temp: 1.24 +context: 8192 +``` + +# Benchmarks: +PENDING FULL EVAL diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file