初始化项目,由ModelHub XC社区提供模型
Model: BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF Source: Original Platform
This commit is contained in:
43
.gitattributes
vendored
Normal file
43
.gitattributes
vendored
Normal file
@@ -0,0 +1,43 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
44
README.md
Normal file
44
README.md
Normal file
@@ -0,0 +1,44 @@
|
|||||||
|
---
|
||||||
|
license: mit
|
||||||
|
base_model:
|
||||||
|
- Qwen/Qwen2.5-Coder-14B-Instruct
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
---
|
||||||
|
<div align="center">
|
||||||
|
<img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/>
|
||||||
|
</div>
|
||||||
|
</br>
|
||||||
|
<div align="center">
|
||||||
|
|
||||||
|
# 🚀 Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF
|
||||||
|
|
||||||
|
### Optimized quantized models for efficient inference
|
||||||
|
|
||||||
|
</div>
|
||||||
|
|
||||||
|
## 📋 Overview
|
||||||
|
|
||||||
|
A collection of optimized GGUF quantized models derived from [Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct), providing various performance-quality tradeoffs.
|
||||||
|
|
||||||
|
## 💎 Model Variants
|
||||||
|
|
||||||
|
| Variant | Use Case | Download
|
||||||
|
|---------|-----------|------------|
|
||||||
|
| Q2_K | Basic text completion tasks | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q2_k.gguf?download=true)
|
||||||
|
| Q3_K_M | Memory-efficient quality operations | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q3_k_m.gguf?download=true)
|
||||||
|
| Q4_K_S | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q4_k_s.gguf?download=true)
|
||||||
|
| Q4_K_M | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q4_k_m.gguf?download=true)
|
||||||
|
| Q5_K_S | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q5_k_s.gguf?download=true)
|
||||||
|
| Q5_K_M | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q5_k_m.gguf?download=true)
|
||||||
|
| Q6_K | Superior quality outputs | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q6_k.gguf?download=true)
|
||||||
|
| Q8_0 | Maximum quality, production-grade results | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q8_0.gguf?download=true)
|
||||||
|
|
||||||
|
## 🤝 Contributors
|
||||||
|
|
||||||
|
Developed with ❤️ by [BlossomAI](https://huggingface.co/BlossomsAI)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
<div align="center">
|
||||||
|
<sub>Star ⭐️ this repo if you find it valuable!</sub>
|
||||||
|
</div>
|
||||||
3
q2_k.gguf
Normal file
3
q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a68dfe6a14bee9e43ffa37abeef9f714b050750750222adeb24bd85a83aef979
|
||||||
|
size 5770497472
|
||||||
3
q3_k_m.gguf
Normal file
3
q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:17199b0743210c7d2a690c11f99e5dfc3922a536b9cf0f1ca908eb9de3dded3f
|
||||||
|
size 7339204032
|
||||||
3
q4_k_m.gguf
Normal file
3
q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:75062a7ba3575573cc421a2cbafbf69fb48d0ecb28da2684b577eb609097fbe4
|
||||||
|
size 8988110272
|
||||||
3
q4_k_s.gguf
Normal file
3
q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5a3910b5babaf6d892754e52f877e8a49533e4efdd71d9e1465f5bc048130ea4
|
||||||
|
size 8573431232
|
||||||
3
q5_k_m.gguf
Normal file
3
q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cc64743a6e9867eeb4fa7ffa756ba67f41f10b3b8f3d529ad12402552f0bf796
|
||||||
|
size 10508873152
|
||||||
3
q5_k_s.gguf
Normal file
3
q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:337e0d36a5c8d7d8fbe51827a59b7482b2f91d5fdbf243a34c7d781b4be7eb22
|
||||||
|
size 10266553792
|
||||||
3
q6_k.gguf
Normal file
3
q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d8f7cddda71a88397f3479cb5ff8b36ff9318ec26708ca95b15eeea33a8c9036
|
||||||
|
size 12124683712
|
||||||
Reference in New Issue
Block a user