From 823a70558db6c791053a3ba6cb6849fab650bfb2 Mon Sep 17 00:00:00 2001 From: Michael Radermacher Date: Sat, 13 Apr 2024 06:05:58 +0000 Subject: [PATCH] auto-patch README.md --- README.md | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 8acdf21..1b59ab6 100644 --- a/README.md +++ b/README.md @@ -13,7 +13,6 @@ quantized_by: mradermacher static quants of https://huggingface.co/scribis/Fantastica-7b-Instruct-0.2-Italian_merged - weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion. ## Usage @@ -29,9 +28,18 @@ more details, including on how to concatenate multi-part files. | Link | Type | Size/GB | Notes | |:-----|:-----|--------:|:------| | [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q2_K.gguf) | Q2_K | 2.8 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.IQ3_XS.gguf) | IQ3_XS | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q3_K_S.gguf) | Q3_K_S | 3.3 | | | [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.IQ3_S.gguf) | IQ3_S | 3.3 | beats Q3_K* | | [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.IQ3_M.gguf) | IQ3_M | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q3_K_M.gguf) | Q3_K_M | 3.6 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q3_K_L.gguf) | Q3_K_L | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.IQ4_XS.gguf) | IQ4_XS | 4.0 | | | [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q4_K_S.gguf) | Q4_K_S | 4.2 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q4_K_M.gguf) | Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q5_K_S.gguf) | Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q5_K_M.gguf) | Q5_K_M | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q6_K.gguf) | Q6_K | 6.0 | very good quality | | [GGUF](https://huggingface.co/mradermacher/Fantastica-7b-Instruct-0.2-Italian_merged-GGUF/resolve/main/Fantastica-7b-Instruct-0.2-Italian_merged.Q8_0.gguf) | Q8_0 | 7.8 | fast, best quality |