bartowski/dolphin-2.8-experiment26-7b-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/dolphin-2.8-experiment26-7b-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-19 20:59:07 +08:00
commit a243036b61
16 changed files with 118 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
.gitattributes vendored Normal file
View File

@@ -0,0 +1,48 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
dolphin-2.8-experiment26-7b-fp16.gguf filter=lfs diff=lfs merge=lfs -text

30
README.md Normal file
View File

@@ -0,0 +1,30 @@
---
license: apache-2.0
quantized_by: bartowski
pipeline_tag: text-generation
---
## Llamacpp Quantizations of dolphin-2.8-experiment26-7b
Using <a href="https://github.com/ggerganov/llama.cpp/commit/fa974646e1a2024fc7dc9e6f27cf1f2f5d4a3763">llama.cpp commit fa97464</a> for quantization.
Original model: https://huggingface.co/cognitivecomputations/dolphin-2.8-experiment26-7b
Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Description |
| -------- | ---------- | --------- | ----------- |
| [dolphin-2.8-experiment26-7b-Q8_0.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q8_0.gguf) | Q8_0 | 7.69GB | Extremely high quality, generally unneeded but max available quant. |
| [dolphin-2.8-experiment26-7b-Q6_K.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q6_K.gguf) | Q6_K | 5.94GB | Very high quality, near perfect, *recommended*. |
| [dolphin-2.8-experiment26-7b-Q5_K_M.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q5_K_M.gguf) | Q5_K_M | 5.13GB | High quality, very usable. |
| [dolphin-2.8-experiment26-7b-Q5_K_S.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q5_K_S.gguf) | Q5_K_S | 4.99GB | High quality, very usable. |
| [dolphin-2.8-experiment26-7b-Q5_0.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q5_0.gguf) | Q5_0 | 4.99GB | High quality, older format, generally not recommended. |
| [dolphin-2.8-experiment26-7b-Q4_K_M.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q4_K_M.gguf) | Q4_K_M | 4.36GB | Good quality, similar to 4.25 bpw. |
| [dolphin-2.8-experiment26-7b-Q4_K_S.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q4_K_S.gguf) | Q4_K_S | 4.14GB | Slightly lower quality with small space savings. |
| [dolphin-2.8-experiment26-7b-Q4_0.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q4_0.gguf) | Q4_0 | 4.10GB | Decent quality, older format, generally not recommended. |
| [dolphin-2.8-experiment26-7b-Q3_K_L.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q3_K_L.gguf) | Q3_K_L | 3.82GB | Lower quality but usable, good for low RAM availability. |
| [dolphin-2.8-experiment26-7b-Q3_K_M.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q3_K_M.gguf) | Q3_K_M | 3.51GB | Even lower quality. |
| [dolphin-2.8-experiment26-7b-Q3_K_S.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q3_K_S.gguf) | Q3_K_S | 3.16GB | Low quality, not recommended. |
| [dolphin-2.8-experiment26-7b-Q2_K.gguf](https://huggingface.co/bartowski/dolphin-2.8-experiment26-7b-GGUF/blob/main/dolphin-2.8-experiment26-7b-Q2_K.gguf) | Q2_K | 2.71GB | Extremely low quality, *not* recommended.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
dolphin-2.8-experiment26-7b-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2ae8465f4d56e2992d29bd39e03fb47288acfad51ad763049fd8cbe782b83fa
size 2719252032

3
dolphin-2.8-experiment26-7b-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff5cbc2496026adf16bd2fe56c7e20658fcc2716cbd1c742677b959e7cd99f4e
size 3822035328

3
dolphin-2.8-experiment26-7b-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e1ff15b55b8d1732f80ec9494b840fe4ba40fba5a0ef82149556c608034d521
size 3518996864

3
dolphin-2.8-experiment26-7b-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5590021c355843f52bceb52cc7837e4ee3989246cdaff66fd878652e3892c4af
size 3164578176

3
dolphin-2.8-experiment26-7b-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:53675444a03e262d3153f8b9de73a86edcf102c5a6952f0e025eecec03a61e81
size 4108928448

3
dolphin-2.8-experiment26-7b-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:87e3bd00e747bc536eef9a700b4998651b1d9331dab100a44ece8ab182cce677
size 4368451008

3
dolphin-2.8-experiment26-7b-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba3be02e66c9e7d2c7b3fd5dadcc138eee307b891595ee4c07c49630f7ed61ef
size 4140385728

3
dolphin-2.8-experiment26-7b-Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a37d21b943546c53e7b8568488334387153438994b20718315717799b26ae85e
size 4997728704

3
dolphin-2.8-experiment26-7b-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f04a1743176a38578cec8f849c1b69f05cc637f6e009566cb7478210748333e
size 5131422144

3
dolphin-2.8-experiment26-7b-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b68500dc86431e111e9df06ecfb72a3ae5728f487136e2c7684baa49504c0638
size 4997728704

3
dolphin-2.8-experiment26-7b-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d70bb4966f929a460823023be6fb0bb20354cb391181cdced17f4eb533ac54c9
size 5942078976

3
dolphin-2.8-experiment26-7b-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2be8e97b75cbc92520478dc99e7c066517e2c91a865147d500a4050c7331bb9f
size 7695875456

3
dolphin-2.8-experiment26-7b-fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d72cfce8bea834474b72717bcac64b71300847ecebefea04bca7dc8bd20a75ca
size 14484764992