RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-04 04:48:15 +08:00
commit ab9b92eacd
24 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

57
.gitattributes vendored Normal file
View File

@@ -0,0 +1,57 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q3_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.9.2-qwen2-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

98
README.md Normal file
View File

@@ -0,0 +1,98 @@
Quantization made by Richard Erkhov.
[Github](https://github.com/RichardErkhov)
[Discord](https://discord.gg/pvy7H8DZMG)
[Request more models](https://github.com/RichardErkhov/quant_request)
dolphin-2.9.2-qwen2-7b - GGUF
- Model creator: https://huggingface.co/cognitivecomputations/
- Original model: https://huggingface.co/cognitivecomputations/dolphin-2.9.2-qwen2-7b/
| Name | Quant method | Size |
| ---- | ---- | ---- |
| [dolphin-2.9.2-qwen2-7b.Q2_K.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q2_K.gguf) | Q2_K | 2.81GB |
| [dolphin-2.9.2-qwen2-7b.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.IQ3_XS.gguf) | IQ3_XS | 3.12GB |
| [dolphin-2.9.2-qwen2-7b.IQ3_S.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.IQ3_S.gguf) | IQ3_S | 3.26GB |
| [dolphin-2.9.2-qwen2-7b.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q3_K_S.gguf) | Q3_K_S | 3.25GB |
| [dolphin-2.9.2-qwen2-7b.IQ3_M.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.IQ3_M.gguf) | IQ3_M | 3.33GB |
| [dolphin-2.9.2-qwen2-7b.Q3_K.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q3_K.gguf) | Q3_K | 3.55GB |
| [dolphin-2.9.2-qwen2-7b.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q3_K_M.gguf) | Q3_K_M | 3.55GB |
| [dolphin-2.9.2-qwen2-7b.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q3_K_L.gguf) | Q3_K_L | 3.81GB |
| [dolphin-2.9.2-qwen2-7b.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.IQ4_XS.gguf) | IQ4_XS | 3.96GB |
| [dolphin-2.9.2-qwen2-7b.Q4_0.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q4_0.gguf) | Q4_0 | 4.13GB |
| [dolphin-2.9.2-qwen2-7b.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.IQ4_NL.gguf) | IQ4_NL | 4.16GB |
| [dolphin-2.9.2-qwen2-7b.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q4_K_S.gguf) | Q4_K_S | 4.15GB |
| [dolphin-2.9.2-qwen2-7b.Q4_K.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q4_K.gguf) | Q4_K | 4.36GB |
| [dolphin-2.9.2-qwen2-7b.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q4_K_M.gguf) | Q4_K_M | 4.36GB |
| [dolphin-2.9.2-qwen2-7b.Q4_1.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q4_1.gguf) | Q4_1 | 4.54GB |
| [dolphin-2.9.2-qwen2-7b.Q5_0.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q5_0.gguf) | Q5_0 | 4.95GB |
| [dolphin-2.9.2-qwen2-7b.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q5_K_S.gguf) | Q5_K_S | 4.95GB |
| [dolphin-2.9.2-qwen2-7b.Q5_K.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q5_K.gguf) | Q5_K | 5.07GB |
| [dolphin-2.9.2-qwen2-7b.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q5_K_M.gguf) | Q5_K_M | 5.07GB |
| [dolphin-2.9.2-qwen2-7b.Q5_1.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q5_1.gguf) | Q5_1 | 5.36GB |
| [dolphin-2.9.2-qwen2-7b.Q6_K.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q6_K.gguf) | Q6_K | 5.82GB |
| [dolphin-2.9.2-qwen2-7b.Q8_0.gguf](https://huggingface.co/RichardErkhov/cognitivecomputations_-_dolphin-2.9.2-qwen2-7b-gguf/blob/main/dolphin-2.9.2-qwen2-7b.Q8_0.gguf) | Q8_0 | 7.54GB |
Original model description:
---
license: apache-2.0
base_model: Qwen/Qwen2-7B
tags:
- generated_from_trainer
- axolotl
datasets:
- cognitivecomputations/Dolphin-2.9
- teknium/OpenHermes-2.5
- m-a-p/CodeFeedback-Filtered-Instruction
- cognitivecomputations/dolphin-coder
- cognitivecomputations/samantha-data
- microsoft/orca-math-word-problems-200k
- Locutusque/function-calling-chatml
- internlm/Agent-FLAN
---
# Dolphin 2.9.2 Qwen2 7B 🐬
Curated and trained by Eric Hartford, Lucas Atkins, and Fernando Fernandes, and Cognitive Computations
[![Discord](https://img.shields.io/discord/1156064224225808488?logo=Discord&logoColor=%23ffffff&label=Discord&link=https%3A%2F%2Fdiscord.gg%2FtCMkMDDHwm)](https://discord.gg/cognitivecomputations)
Discord: https://discord.gg/cognitivecomputations
<img src="https://cdn-uploads.huggingface.co/production/uploads/63111b2d88942700629f5771/ldkN1J0WIDQwU4vutGYiD.png" width="600" />
Our appreciation for the sponsors of Dolphin 2.9.2:
- [Crusoe Cloud](https://crusoe.ai/) - provided excellent on-demand 8xH100 node
This model is based on Qwen2-7b, and is governed by [tongyi-qianwen license](LICENSE)
The base model has 128k context, and the full-weight fine-tuning was with 16k sequence length.
example:
```
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
Dolphin-2.9.2 has a variety of instruction, conversational, and coding skills. It also has initial agentic abilities and supports function calling.
Dolphin is uncensored. We have filtered the dataset to remove alignment and bias. This makes the model more compliant. You are advised to implement your own alignment layer before exposing the model as a service. It will be highly compliant with any requests, even unethical ones. Please read my blog post about uncensored models. https://erichartford.com/uncensored-models You are responsible for any content you create using this model. Enjoy responsibly.
Dolphin is licensed according to Qwen's tongyi-qianwen license. We grant permission for any use, including commercial, that falls within accordance with said license. Dolphin was trained on data generated from GPT4, among other models.
## Evals
![image/png](https://i.ibb.co/0Qw3XtM/file-Oq9-Wr-Qx-H2-Wr8-Eb-Gs15z-Rv-TGe.png)

3
dolphin-2.9.2-qwen2-7b.IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62e291582c172ddaf3c2ed54fd2ab180a5a2f4bea3f024ecac7ed9d4f8f17dab
size 3574009344

3
dolphin-2.9.2-qwen2-7b.IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0db66955c61459953ed118820a8c1f8d73d1cc168f28c1ce32ec9bb270d10662
size 3499189760

3
dolphin-2.9.2-qwen2-7b.IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:409e47b7ab30b1df2870cc60ec6810f402cdcbe9632ccb64153aec6051e5c10d
size 3346253312

3
dolphin-2.9.2-qwen2-7b.IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b43b5c0b45df82adac63fcd83293d2d22370e4c417983ff6241613697020bbf6
size 4463271424

3
dolphin-2.9.2-qwen2-7b.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8b97d10de12394b51150be87789f40d0ad1b327f5543a4285d599ad0b7e01fdc
size 4250295808

3
dolphin-2.9.2-qwen2-7b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73be2afacb8dfda1c1e33b40fdedf77f2c0d706e02b3a394db3ac227250f0553
size 3015937536

3
dolphin-2.9.2-qwen2-7b.Q3_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21ded19912503e167e8c920179f6c8a028d221b4e806c13ca65ae9b421f2e71c
size 3808388608

3
dolphin-2.9.2-qwen2-7b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f52b4cdd02324f10a85e2b6dd3182ac73c6e308a14230c577a65e5b33a0cdbad
size 4088456704

3
dolphin-2.9.2-qwen2-7b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:21ded19912503e167e8c920179f6c8a028d221b4e806c13ca65ae9b421f2e71c
size 3808388608

3
dolphin-2.9.2-qwen2-7b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37ea066ffdb462cb83caf84c8096d73faa8754021d8d34a4ac10bb5d944d21e6
size 3492365824

3
dolphin-2.9.2-qwen2-7b.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a8295a997c335dbefc05dc96808ff1d157275cd653da10e0de8025ddd0d7f9d8
size 4431388160

3
dolphin-2.9.2-qwen2-7b.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:76e8f900bc62bafb213e7224852790d5a77ca19dec84c8b930be7b25d3bf7ad7
size 4873281024

3
dolphin-2.9.2-qwen2-7b.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83c044c732b0ac20790ac1a14397ff393cc23829868764214a8a178b81f5a0cf
size 4683070976

3
dolphin-2.9.2-qwen2-7b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83c044c732b0ac20790ac1a14397ff393cc23829868764214a8a178b81f5a0cf
size 4683070976

3
dolphin-2.9.2-qwen2-7b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5bacf86d79a880f76bd3973eb83f7890d4a014c10e9f499367ba31fc381f5e8e
size 4457766400

3
dolphin-2.9.2-qwen2-7b.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c12df5d6ccc1540bd3176d77d7ace976addcb2a93de1cc40aac7c4343716f567
size 5315173888

3
dolphin-2.9.2-qwen2-7b.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab7c7c2f856bd894953cf67235154b42e2d17eef3fd7a514ac59c9687fb5dc93
size 5757066752

3
dolphin-2.9.2-qwen2-7b.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e61a4f0941e7f0418f5d49a68ef21427492c15ca0a58b0c1d68889eb198740fd
size 5444828672

3
dolphin-2.9.2-qwen2-7b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e61a4f0941e7f0418f5d49a68ef21427492c15ca0a58b0c1d68889eb198740fd
size 5444828672

3
dolphin-2.9.2-qwen2-7b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d95103c75423d0303d2929c77acb78f0619968f81873087a88cb12b5ecf829ed
size 5315173888

3
dolphin-2.9.2-qwen2-7b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37b7f803fb43efba345d514b0cecd1edb955349b0d3389c73fa4aa67d1ddd3df
size 6254196224

3
dolphin-2.9.2-qwen2-7b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1316062d368a7a8a960f5e4d59d1abb115f7d595a69e720fc1bda9ac408f5972
size 8098522624