commit a489a4d3de12dac21c3263b62bc653e2a3030fa8 Author: ModelHub XC Date: Wed Sep 30 17:15:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Blur-7b-slerp-v1.41-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..ab0520c --- /dev/null +++ b/.gitattributes @@ -0,0 +1,58 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Blur-7b-slerp-v1.41.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Blur-7b-slerp-v1.41.i1-IQ1_M.gguf b/Blur-7b-slerp-v1.41.i1-IQ1_M.gguf new file mode 100644 index 0000000..e5c5f08 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12b8e26ae7c84bf2fa6d122ea37a86ca09952d7892a97914498a018ea7fc32a2 +size 1754446784 diff --git a/Blur-7b-slerp-v1.41.i1-IQ1_S.gguf b/Blur-7b-slerp-v1.41.i1-IQ1_S.gguf new file mode 100644 index 0000000..c349401 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9a8a6cb536effb5ae40a15bee0625c3167363a6739e813f0f6efd7de87bf5217 +size 1612102592 diff --git a/Blur-7b-slerp-v1.41.i1-IQ2_M.gguf b/Blur-7b-slerp-v1.41.i1-IQ2_M.gguf new file mode 100644 index 0000000..82d9302 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4ab6b6d15594e54696d8df3cea9368a165027b9c941620463f94a8de2810d12 +size 2500713408 diff --git a/Blur-7b-slerp-v1.41.i1-IQ2_S.gguf b/Blur-7b-slerp-v1.41.i1-IQ2_S.gguf new file mode 100644 index 0000000..fe6210f --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2d55935d8165bc3c217cd88eb31a21f8c94cb1d03121c08b69bb732d21bb401c +size 2310921152 diff --git a/Blur-7b-slerp-v1.41.i1-IQ2_XS.gguf b/Blur-7b-slerp-v1.41.i1-IQ2_XS.gguf new file mode 100644 index 0000000..af269b5 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1ac61fd2d6e9becd28ce9236b0bf0e39c71899fcc4db19e81f44c0ccca588ab2 +size 2198256576 diff --git a/Blur-7b-slerp-v1.41.i1-IQ2_XXS.gguf b/Blur-7b-slerp-v1.41.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..961b576 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b1aa0a1c0365a46319db646301fcdc03abb755df4b91ccd11c5cb33c690b72b8 +size 1991687104 diff --git a/Blur-7b-slerp-v1.41.i1-IQ3_M.gguf b/Blur-7b-slerp-v1.41.i1-IQ3_M.gguf new file mode 100644 index 0000000..7abc994 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4167e6eed59d33defc26905a01530b72441b0b5d971f81dcd06c76ec5cee41c1 +size 3284892608 diff --git a/Blur-7b-slerp-v1.41.i1-IQ3_S.gguf b/Blur-7b-slerp-v1.41.i1-IQ3_S.gguf new file mode 100644 index 0000000..c4a6480 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a9e108ca12b54ff2295aebe23db5fc3fe21f1fea2ebe4919ba684b491b847076 +size 3182394304 diff --git a/Blur-7b-slerp-v1.41.i1-IQ3_XS.gguf b/Blur-7b-slerp-v1.41.i1-IQ3_XS.gguf new file mode 100644 index 0000000..6fe44a3 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5792ceddb53b2957b382bd30053bc1f6709abb37ee93e5d516fb2f25b259bf26 +size 3018816448 diff --git a/Blur-7b-slerp-v1.41.i1-IQ3_XXS.gguf b/Blur-7b-slerp-v1.41.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..61a24b9 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c39a026f83f51f71f74436c0b7332bf3461327e11332187157d9a9895960ec72 +size 2827344832 diff --git a/Blur-7b-slerp-v1.41.i1-IQ4_XS.gguf b/Blur-7b-slerp-v1.41.i1-IQ4_XS.gguf new file mode 100644 index 0000000..2d080cc --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c967f0ab365db4b281d9a6da44b731970c1df5cb2bbc3a5e4da25b9da324833 +size 3907689408 diff --git a/Blur-7b-slerp-v1.41.i1-Q2_K.gguf b/Blur-7b-slerp-v1.41.i1-Q2_K.gguf new file mode 100644 index 0000000..ba83506 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da07ea29dc27fc73a0e07f28adec5d39f4f7eba9992fe48e166542896bbe44d1 +size 2719243200 diff --git a/Blur-7b-slerp-v1.41.i1-Q2_K_S.gguf b/Blur-7b-slerp-v1.41.i1-Q2_K_S.gguf new file mode 100644 index 0000000..df8e20c --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5fb2d4d9c330fec717f555ce255e26e23625645927be299c24653621dd0e041c +size 2528926656 diff --git a/Blur-7b-slerp-v1.41.i1-Q3_K_L.gguf b/Blur-7b-slerp-v1.41.i1-Q3_K_L.gguf new file mode 100644 index 0000000..34bd0cc --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:74153e7c6408fd5db58c86a61b00325e0bf8a5165bcd10a14ae9e151987d47af +size 3822025664 diff --git a/Blur-7b-slerp-v1.41.i1-Q3_K_M.gguf b/Blur-7b-slerp-v1.41.i1-Q3_K_M.gguf new file mode 100644 index 0000000..5a19c44 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f67bb4aa549701c339ace418a780ad9fa7bd6b5a556e6cb6e6178e0833e642b9 +size 3518987200 diff --git a/Blur-7b-slerp-v1.41.i1-Q3_K_S.gguf b/Blur-7b-slerp-v1.41.i1-Q3_K_S.gguf new file mode 100644 index 0000000..2992c88 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:524a7219ab02d1b02aadd31e99bdeaa687ac3770eb71fa3cdb167cae32f4d514 +size 3164568512 diff --git a/Blur-7b-slerp-v1.41.i1-Q4_0.gguf b/Blur-7b-slerp-v1.41.i1-Q4_0.gguf new file mode 100644 index 0000000..5d28042 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dddc34f9e1ce4bf454fa274a7b27b8a81046a24e3040dea2baa7d581c7e5b06e +size 4123597760 diff --git a/Blur-7b-slerp-v1.41.i1-Q4_K_M.gguf b/Blur-7b-slerp-v1.41.i1-Q4_K_M.gguf new file mode 100644 index 0000000..1df92e8 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:172507a827f78ac06a18a19f055792e04b1a5c27a7c3bc1f5c97fc96b28eac41 +size 4368440256 diff --git a/Blur-7b-slerp-v1.41.i1-Q4_K_S.gguf b/Blur-7b-slerp-v1.41.i1-Q4_K_S.gguf new file mode 100644 index 0000000..29224d2 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f3daa8122eb8d5511df392889b3bdd194dfb1de8a7b292b7ab824deca66e0038 +size 4140374976 diff --git a/Blur-7b-slerp-v1.41.i1-Q5_K_M.gguf b/Blur-7b-slerp-v1.41.i1-Q5_K_M.gguf new file mode 100644 index 0000000..7f21375 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e20ca1b76d7c34e513856986290c9ea3806b3fce61610c2f8c4088756e05238a +size 5131410368 diff --git a/Blur-7b-slerp-v1.41.i1-Q5_K_S.gguf b/Blur-7b-slerp-v1.41.i1-Q5_K_S.gguf new file mode 100644 index 0000000..7141e25 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2f3969b3c7470d79c346ae4cd61bdd89ed5e2e80eb45710ba240625d19fb64f3 +size 4997716928 diff --git a/Blur-7b-slerp-v1.41.i1-Q6_K.gguf b/Blur-7b-slerp-v1.41.i1-Q6_K.gguf new file mode 100644 index 0000000..6334c77 --- /dev/null +++ b/Blur-7b-slerp-v1.41.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7653eca1077c0ebb5f831fd2a8119a0f54993291021db4223e41a593e2883033 +size 5942066112 diff --git a/README.md b/README.md new file mode 100644 index 0000000..5c63001 --- /dev/null +++ b/README.md @@ -0,0 +1,80 @@ +--- +base_model: liminerity/Blur-7b-slerp-v1.41 +language: +- en +library_name: transformers +license: apache-2.0 +quantized_by: mradermacher +tags: +- merge +- mergekit +- lazymergekit +- bardsai/jaskier-7b-dpo-v5.6 +- liminerity/merge +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/liminerity/Blur-7b-slerp-v1.41 + + +static quants are available at https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ1_S.gguf) | i1-IQ1_S | 1.7 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ1_M.gguf) | i1-IQ1_M | 1.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.1 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.3 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ2_S.gguf) | i1-IQ2_S | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ2_M.gguf) | i1-IQ2_M | 2.6 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q2_K_S.gguf) | i1-Q2_K_S | 2.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 2.9 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.1 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.3 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ3_S.gguf) | i1-IQ3_S | 3.3 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ3_M.gguf) | i1-IQ3_M | 3.4 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q3_K_M.gguf) | i1-Q3_K_M | 3.6 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q3_K_L.gguf) | i1-Q3_K_L | 3.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q4_0.gguf) | i1-Q4_0 | 4.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/Blur-7b-slerp-v1.41-i1-GGUF/resolve/main/Blur-7b-slerp-v1.41.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..3403937 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7f76438d1debf42f2f483dd7898201180c51412b53a67b8953134c857c8c9dba +size 4988157