From 10e9dfec5629e23cfa1d24ea6e436af852bd4ec8 Mon Sep 17 00:00:00 2001 From: team mradermacher Date: Tue, 11 Mar 2025 01:24:26 +0000 Subject: [PATCH] auto-patch README.md --- README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/README.md b/README.md index b767435..5c2835c 100644 --- a/README.md +++ b/README.md @@ -35,11 +35,14 @@ more details, including on how to concatenate multi-part files. | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q3_K_S.gguf) | Q3_K_S | 4.4 | | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q3_K_M.gguf) | Q3_K_M | 4.9 | lower quality | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q3_K_L.gguf) | Q3_K_L | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.IQ4_XS.gguf) | IQ4_XS | 5.3 | | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q4_K_S.gguf) | Q4_K_S | 5.6 | fast, recommended | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q4_K_M.gguf) | Q4_K_M | 5.9 | fast, recommended | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q5_K_S.gguf) | Q5_K_S | 6.6 | | +| [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q5_K_M.gguf) | Q5_K_M | 6.7 | | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q6_K.gguf) | Q6_K | 7.7 | very good quality | | [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.Q8_0.gguf) | Q8_0 | 9.9 | fast, best quality | +| [GGUF](https://huggingface.co/mradermacher/Dirty-Shirley-v1-9B-Uncensored-TIES-GGUF/resolve/main/Dirty-Shirley-v1-9B-Uncensored-TIES.f16.gguf) | f16 | 18.6 | 16 bpw, overkill | Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):