commit 01288be85eb97d9d5becaa459d346de65111bca6 Author: ModelHub XC Date: Mon Oct 5 08:41:16 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/LLMWriter-3B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..b64d72b --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +LLMWriter-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LLMWriter-3B.i1-IQ1_M.gguf b/LLMWriter-3B.i1-IQ1_M.gguf new file mode 100644 index 0000000..051452c --- /dev/null +++ b/LLMWriter-3B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:150c49f07ff4152909110c3e0861ad07ea3d3e4423d4107b5afc7bda7d036b11 +size 2161972800 diff --git a/LLMWriter-3B.i1-IQ1_S.gguf b/LLMWriter-3B.i1-IQ1_S.gguf new file mode 100644 index 0000000..c0557cd --- /dev/null +++ b/LLMWriter-3B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9804a4f1388c22f2a6aaef37ab1a97727643807071142aa60d3d96ccd4f7c56c +size 2019628608 diff --git a/LLMWriter-3B.i1-IQ2_M.gguf b/LLMWriter-3B.i1-IQ2_M.gguf new file mode 100644 index 0000000..88eeff2 --- /dev/null +++ b/LLMWriter-3B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d9fae9308df217ea48613acee4cf2aed20f5f709c1a93cffe41fedc5df7a9c3 +size 2948281920 diff --git a/LLMWriter-3B.i1-IQ2_S.gguf b/LLMWriter-3B.i1-IQ2_S.gguf new file mode 100644 index 0000000..795dcc9 --- /dev/null +++ b/LLMWriter-3B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ce7e38631d434dc2578522ef75dd7746e753ba5366504316f1a8a659dbbe1e2d +size 2758489664 diff --git a/LLMWriter-3B.i1-IQ2_XS.gguf b/LLMWriter-3B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..9b59dd0 --- /dev/null +++ b/LLMWriter-3B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e4e6b461d1104fd93cfaba296970af8e91167aaf19a50efcd53987a6d03e493d +size 2605782592 diff --git a/LLMWriter-3B.i1-IQ2_XXS.gguf b/LLMWriter-3B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..6aff327 --- /dev/null +++ b/LLMWriter-3B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b543cdb545bdc1a8b82b38454e2a780712c4acb6b36d92f8cae81a113c387fd +size 2399213120 diff --git a/LLMWriter-3B.i1-IQ3_M.gguf b/LLMWriter-3B.i1-IQ3_M.gguf new file mode 100644 index 0000000..736f885 --- /dev/null +++ b/LLMWriter-3B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8221af98dbf589fe3347d47e6676a1595fbc3d3e643358aff57737a76707917b +size 3784824384 diff --git a/LLMWriter-3B.i1-IQ3_S.gguf b/LLMWriter-3B.i1-IQ3_S.gguf new file mode 100644 index 0000000..0837e36 --- /dev/null +++ b/LLMWriter-3B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b4b5470c9412ec3f20a2c4fa1d7b9d21e8246c08b720b9f8a68c07801636f7fc +size 3682326080 diff --git a/LLMWriter-3B.i1-IQ3_XS.gguf b/LLMWriter-3B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..5585f80 --- /dev/null +++ b/LLMWriter-3B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:878a80ddfbc1378ada59068d4a7ef385a863f8d25bd80f5c5bcd1354baa98ffc +size 3518748224 diff --git a/LLMWriter-3B.i1-IQ3_XXS.gguf b/LLMWriter-3B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..3375642 --- /dev/null +++ b/LLMWriter-3B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5fa7dc8c45670d9d7fbc97a30062dbe59c273cc2c8e908df5119e7ae23bd502e +size 3274913344 diff --git a/LLMWriter-3B.i1-IQ4_NL.gguf b/LLMWriter-3B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..2b0262a --- /dev/null +++ b/LLMWriter-3B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24fa39489281198b91a8e97b478e25d12ddcfe3f377439a3ebc45c5b0e95ac32 +size 4677989952 diff --git a/LLMWriter-3B.i1-IQ4_XS.gguf b/LLMWriter-3B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e104fc9 --- /dev/null +++ b/LLMWriter-3B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:66d86b756aa67df9fe7ebd30bbc1db830fedda408e605c363e39b89fe8710c90 +size 4447663680 diff --git a/LLMWriter-3B.i1-Q2_K.gguf b/LLMWriter-3B.i1-Q2_K.gguf new file mode 100644 index 0000000..beeacff --- /dev/null +++ b/LLMWriter-3B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d56b9b944db9b34ffec6254198b960904d1965d1811e94027b323aad2fd2e562 +size 3179132480 diff --git a/LLMWriter-3B.i1-Q2_K_S.gguf b/LLMWriter-3B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..23f699c --- /dev/null +++ b/LLMWriter-3B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e3aaecba73e3c77a311ec0328a23f15e51a1da9d509a1be42517c613cfb31226 +size 2988815936 diff --git a/LLMWriter-3B.i1-Q3_K_L.gguf b/LLMWriter-3B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..7c9de07 --- /dev/null +++ b/LLMWriter-3B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0810c0685c2523289373b0913e2d5d1161e38144fc69e2dc1977bd5a68da4d57 +size 4321957440 diff --git a/LLMWriter-3B.i1-Q3_K_M.gguf b/LLMWriter-3B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..214038e --- /dev/null +++ b/LLMWriter-3B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3f66191341c0c8f1d7754b8051545978d147841a35a86218b1fc55521cff736d +size 4018918976 diff --git a/LLMWriter-3B.i1-Q3_K_S.gguf b/LLMWriter-3B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..9cf54f3 --- /dev/null +++ b/LLMWriter-3B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:24a2f43cce15a2d78ad479b150874a41a6d70826edd02b24de49fafb66d069fa +size 3664500288 diff --git a/LLMWriter-3B.i1-Q4_0.gguf b/LLMWriter-3B.i1-Q4_0.gguf new file mode 100644 index 0000000..e7597b3 --- /dev/null +++ b/LLMWriter-3B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d7adc2e66e9f712ea3224f679e3c44906deaeabebcc675c05ac749dbb0a3deb +size 4675892800 diff --git a/LLMWriter-3B.i1-Q4_1.gguf b/LLMWriter-3B.i1-Q4_1.gguf new file mode 100644 index 0000000..f233706 --- /dev/null +++ b/LLMWriter-3B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:05434c2c7f600b75ba01bb0d9478e4b88f1179b2a9b2985d6ce010a564c85b53 +size 5130253888 diff --git a/LLMWriter-3B.i1-Q4_K_M.gguf b/LLMWriter-3B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..eab0d14 --- /dev/null +++ b/LLMWriter-3B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:12ac00cd473881b0a98694db09177b367686cc793b45c0554866a3c617605c99 +size 4920735296 diff --git a/LLMWriter-3B.i1-Q4_K_S.gguf b/LLMWriter-3B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..b0d3c93 --- /dev/null +++ b/LLMWriter-3B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3bb7205f4b110962a465c2dd4f16ce856411ff79896ce37cf5d4932e9f3b6082 +size 4692670016 diff --git a/LLMWriter-3B.i1-Q5_K_M.gguf b/LLMWriter-3B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..1f07ca1 --- /dev/null +++ b/LLMWriter-3B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80a5cf8805476f2f2c2b26b456a3bc176a1295950bd3d3b527a3680de52fe88d +size 5732988480 diff --git a/LLMWriter-3B.i1-Q5_K_S.gguf b/LLMWriter-3B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..c0e008d --- /dev/null +++ b/LLMWriter-3B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0e2eef927b27edc09f2e722a61815777f2c35d9694bd74e8b2edf760814498f3 +size 5599295040 diff --git a/LLMWriter-3B.i1-Q6_K.gguf b/LLMWriter-3B.i1-Q6_K.gguf new file mode 100644 index 0000000..58620ab --- /dev/null +++ b/LLMWriter-3B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:77fce5371f4445840b8d7f6731830ded66461d17cee887b98d5707c689fab263 +size 6596007488 diff --git a/LLMWriter-3B.imatrix.gguf b/LLMWriter-3B.imatrix.gguf new file mode 100644 index 0000000..ce87f97 --- /dev/null +++ b/LLMWriter-3B.imatrix.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8513e5a71ea45f943d8e014a260e665b42b551abbff2fee888a755ee297d2c1d +size 5015200 diff --git a/README.md b/README.md new file mode 100644 index 0000000..d8cb4f6 --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +base_model: aldenirsrv/LLMWriter-3B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- text-generation-inference +- transformers +- unsloth +- llama +--- +## About + + + + + + + + + +weighted/imatrix quants of https://huggingface.co/aldenirsrv/LLMWriter-3B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LLMWriter-3B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/LLMWriter-3B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + +