Compare commits

..

10 Commits

9 changed files with 22 additions and 18 deletions

View File

@@ -2,13 +2,17 @@
quantized_by: bartowski
pipeline_tag: text-generation
base_model: mlabonne/Qwen3-14B-abliterated
tags: []
tags:
- abliteration
- abliterated
license: apache-2.0
license_link: https://huggingface.co/Qwen/Qwen3-14B/blob/main/LICENSE
base_model_relation: quantized
---
## Llamacpp imatrix Quantizations of Qwen3-14B-abliterated by mlabonne
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5270">b5270</a> for quantization.
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5415">b5415</a> for quantization.
Original model: https://huggingface.co/mlabonne/Qwen3-14B-abliterated
@@ -30,7 +34,7 @@ Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or a
## What's new:
New model files from mlabonne (WIP model)
Original model updated
## Download a file (not the whole branch) from below:

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28c2a82fe0673e58d83b62ec54ebb4623aa210f3a965335d7274e4723db632bf
size 5322941568
oid sha256:5c05b774d4af43f748862331af0e5cf6b7c4f4b0ab995491fe9f954a54b80cb4
size 5322941536

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9766fe2e78022adebbfc8881bda57d238f379a428e5b061e9275ceca51e7af03
size 4963312768
oid sha256:672e0b086d8f56537a60bd108f28f819ac7cbe7f67f34fc259f09dbef7ad4ae7
size 4963312736

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46ef4d55d3ff530aca9094f069b19aeee01f79dd82c9c02cab75863e6d5ae49a
size 6375301248
oid sha256:eea8f9e4433a903abb1e75eb0452089e425fc6dddc6d11eb21071e5fe8246eee
size 6375301216

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e20499c6baa52f8e506adf43eb39e74224dad258a728f1ab846bcf2cddf524c5
size 5942666368
oid sha256:9df30e4013cbf732b55d6437cfce3765d7e8f9567001aea80b3ccceb53fd698f
size 5942666336

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fb297e6db756edaf85719bc5e64cc04e848f1a1245c554c7623a5106b14bb75
size 5753984128
oid sha256:1c87c0c198e0b3f7861f868176935916ef7f487965b1a781cf76f2b04f483b15
size 5753984096

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c3686b6a4d616928a6cc46b8502415664937cef353124d7f1afc7637f89fb584
size 6513664128
oid sha256:fee726573fb376291bbf08acdcca961bdbd4cb8b85891b3b979f4feef5c73092
size 6513664096

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:321799108f66df965be62457478c7921aec36317b23b73d14d0333c939b8c245
size 29543423840
oid sha256:84a64243f08fbaf3b279e237659b61797e49623a092d21f131aab990ebdbc7d3
size 29543423808

View File

@@ -1,3 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:886380af23fb1963f4ffa6370e1bbfcd49ad61eda3fdac827287d05254a87d3f
oid sha256:0b7caf7292d6e4309bceb90b21a43321be48ad56b05c8ac665e31b920dcd0105
size 7709778