From debb134ce059af011ec1df87f9ce97d393a8096e Mon Sep 17 00:00:00 2001 From: Ed Addario Date: Mon, 30 Jun 2025 19:26:23 +0100 Subject: [PATCH] Layer-wise & pruned quantization Q6_K --- Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf diff --git a/Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf b/Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf new file mode 100644 index 0000000..f03b8e4 --- /dev/null +++ b/Dolphin-Mistral-24B-Venice-Edition-pruned-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a79cc78ede99402be7cfd56f4ae10c3e6abeb9d7f16787faa7e6a630d5c687e +size 16782292224