commit 98c3716cc05a67e1c82a48a8fa8fd667c004bb02 Author: ModelHub XC Date: Sun May 17 19:54:10 2026 +0800 初始化项目,由ModelHub XC社区提供模型 Model: BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ce5e303 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,43 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +q2_k.gguf filter=lfs diff=lfs merge=lfs -text +q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text +q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text +q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text +q6_k.gguf filter=lfs diff=lfs merge=lfs -text +q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..74f7460 --- /dev/null +++ b/README.md @@ -0,0 +1,44 @@ +--- +license: mit +base_model: +- Qwen/Qwen2.5-Coder-14B-Instruct +pipeline_tag: text-generation +--- +
+Logo +
+
+
+ +# 🚀 Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF + +### Optimized quantized models for efficient inference + +
+ +## 📋 Overview + +A collection of optimized GGUF quantized models derived from [Qwen/Qwen2.5-Coder-14B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-14B-Instruct), providing various performance-quality tradeoffs. + +## 💎 Model Variants + +| Variant | Use Case | Download +|---------|-----------|------------| +| Q2_K | Basic text completion tasks | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q2_k.gguf?download=true) +| Q3_K_M | Memory-efficient quality operations | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q3_k_m.gguf?download=true) +| Q4_K_S | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q4_k_s.gguf?download=true) +| Q4_K_M | Balanced performance and quality | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q4_k_m.gguf?download=true) +| Q5_K_S | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q5_k_s.gguf?download=true) +| Q5_K_M | Enhanced quality text generation | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q5_k_m.gguf?download=true) +| Q6_K | Superior quality outputs | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q6_k.gguf?download=true) +| Q8_0 | Maximum quality, production-grade results | [📥](https://huggingface.co/BlossomsAI/Qwen2.5-Coder-14B-Instruct-Uncensored-GGUF/resolve/main/q8_0.gguf?download=true) + +## 🤝 Contributors + +Developed with ❤️ by [BlossomAI](https://huggingface.co/BlossomsAI) + +--- + +
+Star ⭐️ this repo if you find it valuable! +
\ No newline at end of file diff --git a/q2_k.gguf b/q2_k.gguf new file mode 100644 index 0000000..01a7e31 --- /dev/null +++ b/q2_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a68dfe6a14bee9e43ffa37abeef9f714b050750750222adeb24bd85a83aef979 +size 5770497472 diff --git a/q3_k_m.gguf b/q3_k_m.gguf new file mode 100644 index 0000000..d259908 --- /dev/null +++ b/q3_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:17199b0743210c7d2a690c11f99e5dfc3922a536b9cf0f1ca908eb9de3dded3f +size 7339204032 diff --git a/q4_k_m.gguf b/q4_k_m.gguf new file mode 100644 index 0000000..7c7813e --- /dev/null +++ b/q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:75062a7ba3575573cc421a2cbafbf69fb48d0ecb28da2684b577eb609097fbe4 +size 8988110272 diff --git a/q4_k_s.gguf b/q4_k_s.gguf new file mode 100644 index 0000000..a3285b6 --- /dev/null +++ b/q4_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a3910b5babaf6d892754e52f877e8a49533e4efdd71d9e1465f5bc048130ea4 +size 8573431232 diff --git a/q5_k_m.gguf b/q5_k_m.gguf new file mode 100644 index 0000000..facb450 --- /dev/null +++ b/q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc64743a6e9867eeb4fa7ffa756ba67f41f10b3b8f3d529ad12402552f0bf796 +size 10508873152 diff --git a/q5_k_s.gguf b/q5_k_s.gguf new file mode 100644 index 0000000..4920e76 --- /dev/null +++ b/q5_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:337e0d36a5c8d7d8fbe51827a59b7482b2f91d5fdbf243a34c7d781b4be7eb22 +size 10266553792 diff --git a/q6_k.gguf b/q6_k.gguf new file mode 100644 index 0000000..6eceb15 --- /dev/null +++ b/q6_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d8f7cddda71a88397f3479cb5ff8b36ff9318ec26708ca95b15eeea33a8c9036 +size 12124683712 diff --git a/q8_0.gguf b/q8_0.gguf new file mode 100644 index 0000000..09f1751 --- /dev/null +++ b/q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a083bde5a4f52c99f2bc918fc75d67e3e99e35b0f019c1e7df3494a66f893986 +size 15701597632