mradermacher/L3-DeepDolph-R1-8B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/L3-DeepDolph-R1-8B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-10 18:59:19 +08:00
commit c8a4100a94
27 changed files with 213 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
L3-DeepDolph-R1-8B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
L3-DeepDolph-R1-8B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f7cf1f17557eadca99d4814238eed011a620822467cd43d8640f16e3edf4cb08
size 2161975296

3
L3-DeepDolph-R1-8B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4db1d55043d9c65becb243fa2f9682c087a572735de75e1892d9576c3a22f40d
size 2019631104

3
L3-DeepDolph-R1-8B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ca30b877ccf85f28ac2805518bd0f3fd5ccbf9f19ffbc142cbe0c46d253ab6bd
size 2948284416

3
L3-DeepDolph-R1-8B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22ffabf5b7f2153de810ecb402f57564dfb93edee1283ceb579d0aa338740b73
size 2758492160

3
L3-DeepDolph-R1-8B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:426c8bc02ed360c6fd61ad21d603740e4d3a982713c59ed6619764f0b5fa7cc3
size 2605785088

3
L3-DeepDolph-R1-8B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fd117ba047a8f24928cf45b03b9afb6fceef3951bc8318ea646f138d6a32cc4
size 2399215616

3
L3-DeepDolph-R1-8B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c59a839cd3e4acccc0ca9221657efc6cbcef97a88453d219681f73c609b8afba
size 3784826880

3
L3-DeepDolph-R1-8B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0be0a59dd2e945ca94699056371f8b4fffdbb18884fd8833ab68e698bb1dc822
size 3682328576

3
L3-DeepDolph-R1-8B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7a60ed868b5e35837ad25319ac431a60761c5270d6bdb743af9c89804a356181
size 3518750720

3
L3-DeepDolph-R1-8B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ddd382c5b0878878ec155feb1effe2a4ecaf29454e1ae2cfbaa6487630631b6
size 3274915840

3
L3-DeepDolph-R1-8B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1db847ea2da92c708e23591f980d7aad79bfcf3528a757503bb6c6d1a171a4b2
size 4677992448

3
L3-DeepDolph-R1-8B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3720ad850316e4eb4e3387fd0f3733643b56b92b2ebab1e25d5e56a9fc30c75
size 4447666176

3
L3-DeepDolph-R1-8B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:16ff32c1bf11a69f092c52e328d1286aa775ff0e32b0db233abde380d012b324
size 3179134976

3
L3-DeepDolph-R1-8B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:006883cd1852ca39aee129ca6a5034fcbe112b67ebad1e1da42d127cf5ad9328
size 2988818432

3
L3-DeepDolph-R1-8B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6a74ec827d7f9273b5b7d7b2064ac07bc68065775590aa0a6e18d9c055928b64
size 4321959936

3
L3-DeepDolph-R1-8B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f834a6ba62b01817d35d55482df86144bfdd1a6b645bb4b5d0e9c40a9185ac7
size 4018921472

3
L3-DeepDolph-R1-8B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c477bf95bd80968875f29916e14df46bc03c256b17fe6d934556f426e4ad8d0b
size 3664502784

3
L3-DeepDolph-R1-8B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:14e1f05a49c0d1534c2428c6c267860c2b833d073c2a8ce63bd8bfb79f5c702e
size 4675895296

3
L3-DeepDolph-R1-8B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:73e4a9b9ad2c77e85f88fc441f553257ecd0820d946a2c16fe0e8cf420eb9b98
size 5130256384

3
L3-DeepDolph-R1-8B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:facddb260f160a15ea502ef9c47ed353b1d022cbecc562983d6c1bef32ff20e2
size 4920737792

3
L3-DeepDolph-R1-8B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4944fa76736572b6c40d3df7dbcf63c8620a71b605861f29df1cf6f6ded2acb5
size 4692672512

3
L3-DeepDolph-R1-8B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20c97ffcf49425077ce3a4eb05b0f0ea466f6e83e40ba2ac91e6ed022f40d9d5
size 5732990976

3
L3-DeepDolph-R1-8B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7c59df4d707ba33f550c0db29cbdf0c6624052b242eeaa4f6e06d7ccae0fa5e6
size 5599297536

3
L3-DeepDolph-R1-8B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80ba40a4c8b8aeaf0ce49bb86f32331bb570a7170f0aeb9b7daf41f0ac391d3d
size 6596009984

78
README.md Normal file
View File

@@ -0,0 +1,78 @@
---
base_model: DopeyGay/L3-DeepDolph-R1-8B
language:
- en
library_name: transformers
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/DopeyGay/L3-DeepDolph-R1-8B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/L3-DeepDolph-R1-8B-i1-GGUF/resolve/main/L3-DeepDolph-R1-8B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:41af7a4fd45fd76de8490c234e0c64dd5275be0dc252ec59f429c89268365bee
size 4988157