commit 116f083bb80f00fb52c00dc5b1803ea7d5eda65f Author: ModelHub XC Date: Tue Apr 21 23:01:55 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/HamzahLMV0-3B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..0a7a5ff --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +HamzahLMV0-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/HamzahLMV0-3B.i1-IQ1_M.gguf b/HamzahLMV0-3B.i1-IQ1_M.gguf new file mode 100644 index 0000000..c1945f5 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:94b1549ef250166fed159cf4fbfc9432fcd4b42d8ff33ced2ac4f475d6222562 +size 924188576 diff --git a/HamzahLMV0-3B.i1-IQ1_S.gguf b/HamzahLMV0-3B.i1-IQ1_S.gguf new file mode 100644 index 0000000..af701a3 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c5ee030ab7790583869c4627e14babd55c2c85c496d7a72adb3d0f508933b998 +size 868155296 diff --git a/HamzahLMV0-3B.i1-IQ2_M.gguf b/HamzahLMV0-3B.i1-IQ2_M.gguf new file mode 100644 index 0000000..284c0ee --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb91cb7e1fcb5479609b09a5c30d3a12a209bfe26cc0878963c53f685f5822a2 +size 1229029280 diff --git a/HamzahLMV0-3B.i1-IQ2_S.gguf b/HamzahLMV0-3B.i1-IQ2_S.gguf new file mode 100644 index 0000000..b456d5e --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cefd4feb0766ac1672f21212ad8b22da93490ee7e5cd1b2551eb593bec8b3f9a +size 1154318240 diff --git a/HamzahLMV0-3B.i1-IQ2_XS.gguf b/HamzahLMV0-3B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..13003e8 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2bbf144a673881e9c7add227a97debceef2a12be20385fb58a668c77a416bef +size 1100545952 diff --git a/HamzahLMV0-3B.i1-IQ2_XXS.gguf b/HamzahLMV0-3B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..bb641e7 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3d7cc657d121a48d19f41edea916612e3ae939a23fe34395f82b927665fadcf4 +size 1017577376 diff --git a/HamzahLMV0-3B.i1-IQ3_M.gguf b/HamzahLMV0-3B.i1-IQ3_M.gguf new file mode 100644 index 0000000..b88f50f --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4d92557561fca73f5a9b5c0cf1f43e4650658b8ad7c48f0cd40b191c2e5887df +size 1599666080 diff --git a/HamzahLMV0-3B.i1-IQ3_S.gguf b/HamzahLMV0-3B.i1-IQ3_S.gguf new file mode 100644 index 0000000..0abd39d --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:022ae91cb3681864a792f59caa4b9bd32c5834f57efadd3f9a72d960839331ac +size 1542846368 diff --git a/HamzahLMV0-3B.i1-IQ3_XS.gguf b/HamzahLMV0-3B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..62a3559 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fafa954318e0cae56b21772f8cdec05f0be478f4751569bd81d3320c830f8cea +size 1476786080 diff --git a/HamzahLMV0-3B.i1-IQ3_XXS.gguf b/HamzahLMV0-3B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..f8a6a3f --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:100c9f834638e3aacc634fb52463bac4e48b25b3dc9c093c787c638eaa1a1907 +size 1348763552 diff --git a/HamzahLMV0-3B.i1-IQ4_NL.gguf b/HamzahLMV0-3B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..3558ad4 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6e58b11e336645da483069abec73903484104ce1bba824a3c1e08c8d37323b9f +size 1917188000 diff --git a/HamzahLMV0-3B.i1-IQ4_XS.gguf b/HamzahLMV0-3B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..4a98284 --- /dev/null +++ b/HamzahLMV0-3B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:078e1064c472489311785621cd88ec4d3e602c527e40fd193d38e56f81832a39 +size 1829107616 diff --git a/HamzahLMV0-3B.i1-Q2_K.gguf b/HamzahLMV0-3B.i1-Q2_K.gguf new file mode 100644 index 0000000..7c991a4 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:278f7f25c848e252903b2b41ed80e40109523f0b9ee76946691a8b7aeb9e87b2 +size 1363933088 diff --git a/HamzahLMV0-3B.i1-Q2_K_S.gguf b/HamzahLMV0-3B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..568471b --- /dev/null +++ b/HamzahLMV0-3B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9e34dc6247d01bf02d061aba913192a5c8e41822b1f07d01bc086d6c1dc5199c +size 1274279840 diff --git a/HamzahLMV0-3B.i1-Q3_K_L.gguf b/HamzahLMV0-3B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..e8d49c8 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:61d8a667c1f55cc322d5587746f26b9cee3d5219f57f4cd2b244b70aab0b4f4a +size 1815345056 diff --git a/HamzahLMV0-3B.i1-Q3_K_M.gguf b/HamzahLMV0-3B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..9046310 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:81b40799acb08f565c8cc788b263a09cafcece8f3a00f766b63b91bd08e9edea +size 1687156640 diff --git a/HamzahLMV0-3B.i1-Q3_K_S.gguf b/HamzahLMV0-3B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..37326a0 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:97860ecb97c45dc4c31ade13890ed7ab19e2c4771e3104cfc0308fb1dc8f3aee +size 1542846368 diff --git a/HamzahLMV0-3B.i1-Q4_0.gguf b/HamzahLMV0-3B.i1-Q4_0.gguf new file mode 100644 index 0000000..a7e8a08 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0d35e3beedaad2bb91a5cf9eeba5be29f3fce70a6f499f0545d7239c77165621 +size 1921906592 diff --git a/HamzahLMV0-3B.i1-Q4_1.gguf b/HamzahLMV0-3B.i1-Q4_1.gguf new file mode 100644 index 0000000..236bb93 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c251665e856519fc6a596113dc8213cb0c8bc86f740a078052a7ac5f0d6fbc0 +size 2093348768 diff --git a/HamzahLMV0-3B.i1-Q4_K_M.gguf b/HamzahLMV0-3B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..63d4250 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ec330b926e47eadf7c610a007b24197f62da5c0b0283b7d4d0a3cc72d7b5f495 +size 2019375008 diff --git a/HamzahLMV0-3B.i1-Q4_K_S.gguf b/HamzahLMV0-3B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..0a5c777 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ead1f96069b7053ccb9b2d0089b2f02e9491c9ae637b9f4257b2a1beb62c27ed +size 1928198048 diff --git a/HamzahLMV0-3B.i1-Q5_K_M.gguf b/HamzahLMV0-3B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..8ea452d --- /dev/null +++ b/HamzahLMV0-3B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c41a121671d10cc1c282f3d21d93309455d30705bf7e84a2121ab5d2bd482f2e +size 2322151328 diff --git a/HamzahLMV0-3B.i1-Q5_K_S.gguf b/HamzahLMV0-3B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..c4257b2 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cc189e7c3b743e2909f26c875ad1c9c60c29736ce36ccd71d578e2f1374e148d +size 2269509536 diff --git a/HamzahLMV0-3B.i1-Q6_K.gguf b/HamzahLMV0-3B.i1-Q6_K.gguf new file mode 100644 index 0000000..919a101 --- /dev/null +++ b/HamzahLMV0-3B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a1caf55e08ef7edb33d5b987e533382def5a9f61d5481e546731913cc4070c83 +size 2643851168 diff --git a/README.md b/README.md new file mode 100644 index 0000000..6075b86 --- /dev/null +++ b/README.md @@ -0,0 +1,92 @@ +--- +base_model: XeTute/HamzahLMV0-3B +datasets: +- XeTute/Eastern-Alpaca-14k +- XeTute/iloveuser-1k +- open-thoughts/OpenThoughts-114k +language: +- en +- zh +- de +- pt +- it +- fr +- hi +- es +- th +library_name: transformers +license: llama3.2 +quantized_by: mradermacher +tags: +- tiny +- rp +- roleplay +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/XeTute/HamzahLMV0-3B + + +static quants are available at https://huggingface.co/mradermacher/HamzahLMV0-3B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.0 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.9 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.0 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_0.gguf) | i1-Q4_0 | 2.0 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.0 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.1 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.2 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.4 | | +| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.7 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..3e63245 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:141e048f7afad9fe6e9559b61531a6a75c7916f293c98617e003ce55d6b90edf +size 2988377