30 lines
889 B
Markdown
30 lines
889 B
Markdown
|
---
|
||
|
|
base_model:
|
||
|
|
- mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1
|
||
|
|
library_name: transformers
|
||
|
|
tags:
|
||
|
|
- DeepSeek-R1-Distill-Qwen-7B
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
---
|
||
|
|
|
||
|
|
# Melvin56/DeepSeek-R1-ReDistill-Qwen-7B-v1.1-GGUF
|
||
|
|
|
||
|
|
Original Model : [mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1](https://huggingface.co/mobiuslabsgmbh/DeepSeek-R1-ReDistill-Qwen-7B-v1.1)
|
||
|
|
|
||
|
|
All quants are made using the imatrix option
|
||
|
|
|
||
|
|
| Model | Size (GB) | Params |
|
||
|
|
|:-------------------------------------------------|:-------------:|:-------:|
|
||
|
|
| Q2_K_S | 2.82 GB | 7.62B |
|
||
|
|
| Q2_K | 3.01 GB | 7.62B |
|
||
|
|
| Q3_K_M | 3.80 GB | 7.62B |
|
||
|
|
| Q3_K_M | 3.80 GB | 7.62B |
|
||
|
|
| Q4_0 | 4.43 GB | 7.62B |
|
||
|
|
| Q4_K_M | 4.68 GB | 7.62B |
|
||
|
|
| Q5_K_M | 5.45 GB | 7.62B |
|
||
|
|
| Q6_K | 6.25 GB | 7.62B |
|
||
|
|
| Q8_0 | 8.10 GB | 7.62B |
|
||
|
|
| F16 | 15.23 GB | 7.62B |
|