From 3a6bd3ae0d0b3908ce96db75a65296cd16dee76b Mon Sep 17 00:00:00 2001 From: Ed Addario Date: Tue, 1 Jul 2025 07:38:42 +0100 Subject: [PATCH] Layer-wise & pruned quantization IQ3_M --- Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf diff --git a/Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf b/Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf new file mode 100644 index 0000000..a657905 --- /dev/null +++ b/Dolphin-Mistral-24B-Venice-Edition-pruned-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0aef3c959bb993ff6b3436ceba8f6c84380632e35024212463d2c1b9d87c649a +size 9551090944