mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-18 11:51:50 +08:00
commit fc53e02b0e
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-1.5B-Medical-COT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b27298b1e47d7fe5b68f05db29dfb84182e8d96962a23baab8a73bf4652b6f3e
size 541037280

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac3869399aac885c89fdbc1cddc4592b708ce4ed61d33968323256c8fbf76f4f
size 513103584

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3dc5c09986685f0e6e9e0136da4884701b1294ec04c9013f5211b5d957025dbf
size 701332704

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5493406acc41e10727fb67abe4115bdbcd10079da89702ab11da70a637b76c88
size 664087776

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:055575bb4c6fdb1ca8e38beb524a9c120365d04123573b194f527dad03669c57
size 626902752

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5faadab6f4affae4341c1e6314abd05255cc165dff91bd535753241e618e08a
size 587593440

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6ea897dfa2d46fd08cf7921fb26579a2bd5637e6781c0804e9a29d89d568ea38
size 876942048

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b64b9fa94b7d50426aa0c4b5b4f7603ffa3909bae8c3aa5ccce0ee6a9c54a997
size 862684896

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e319ed4bb28571465976ddb734566d03ffcee06449eb620b72f9ecf202271917
size 831977184

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:daf47a6357a49210b17e2cbb5aefe1bb25d2c895b3a7ec551f674b6ebf25302d
size 769070304

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a9918ab36603e7a6b1b86a36ae2784e3ccd2aa283ef02e54a29b648bd408f746
size 1067604192

3
DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4fd5b99497be75cdc20d2c5f62001d801f7b40643a9f9cd08301b6c95d03b5b9
size 1019711712

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:04fe111004fbd174aa4dd9ab04f852188faddd3c60821e1275892d18fc1a012d
size 752880864

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5cd65895e3abb17113a4936a6069e3603578b4b8dfdefc81519278f94f1b95a7
size 716711136

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b73103b4735d95c05df5ab932465047cc8627af3d9cda8d31caf9bfec2cf001b
size 980440800

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12e25cfaf8e24e2d6a95fdb87aa23638e987448fac59f70da28ab10f33b15cde
size 924456672

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3347b87db642c533d76dad55ea5b0cb16e8f9c79e0f3dc889e9e8f2548d983fc
size 861222624

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:016bd16edaa631c139b4f693b434bddf39d0dc46d483f27c5cb27b3027d1a9ae
size 1068808416

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c51f761f0b3310bff92763533f177ca5c8288a512d7d8596a4d0968ead7d1ea6
size 1162701024

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ea838b813171e17ad15d4f961d37bb176b88db96538a25979456480798e9def
size 1117321440

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6221fa39869966961937300169ecb370ba546feb828aedbc2e25e65e16dbf727
size 1071585504

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fce1f89a8edde36bdf864bc468aac696d1b702b67c0ccc03c0ab8a397d52fbd6
size 1285495008

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fff8307580fe1c6fc50995ba39c31a79cc560c741f7cf594f06d8001a651d6f3
size 1259174112

3
DeepSeek-R1-1.5B-Medical-COT.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10f0ec7267e608e9931f5767b5bf8789d898d8489f664148de72c1dba0d84ffe
size 1464179424

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: j11016/DeepSeek-R1-1.5B-Medical-COT
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- unsloth
- trl
- sft
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/j11016/DeepSeek-R1-1.5B-Medical-COT
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#DeepSeek-R1-1.5B-Medical-COT-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q4_1.gguf) | i1-Q4_1 | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/DeepSeek-R1-1.5B-Medical-COT-i1-GGUF/resolve/main/DeepSeek-R1-1.5B-Medical-COT.i1-Q6_K.gguf) | i1-Q6_K | 1.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a71db612fcd5b29d8e563149acaeb73fa7366f5eb9854c2a586e79a6326f3cde
size 2042201