commit c7f8f59d3460ecce94b7cea60f5b5047ba9e9421 Author: ModelHub XC Date: Wed May 20 00:26:59 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/2B_or_not_2B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..1bfb5d7 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,56 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +2B_or_not_2B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/2B_or_not_2B.i1-IQ1_M.gguf b/2B_or_not_2B.i1-IQ1_M.gguf new file mode 100644 index 0000000..727a8f1 --- /dev/null +++ b/2B_or_not_2B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0022bb86479db12acdc8463c6204f59d7b6b5f7efd9ceace00f0cd60b94f53f7 +size 813845088 diff --git a/2B_or_not_2B.i1-IQ1_S.gguf b/2B_or_not_2B.i1-IQ1_S.gguf new file mode 100644 index 0000000..ee912e9 --- /dev/null +++ b/2B_or_not_2B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d4ffcd014c7b6efe7c51827076c6cf17732f88ebba4917f15b895956208ceecf +size 770959968 diff --git a/2B_or_not_2B.i1-IQ2_M.gguf b/2B_or_not_2B.i1-IQ2_M.gguf new file mode 100644 index 0000000..fc1d589 --- /dev/null +++ b/2B_or_not_2B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:52c018513195fd74d340ad5a61b452e348edfdaaab7123b612b290d528ba4ec5 +size 1019472480 diff --git a/2B_or_not_2B.i1-IQ2_S.gguf b/2B_or_not_2B.i1-IQ2_S.gguf new file mode 100644 index 0000000..16eb1c8 --- /dev/null +++ b/2B_or_not_2B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0abda23f9fe52f175b881086824eed76987b5a69674a012ab8711f68b2b121ba +size 962292320 diff --git a/2B_or_not_2B.i1-IQ2_XS.gguf b/2B_or_not_2B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..fae0425 --- /dev/null +++ b/2B_or_not_2B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46db9007491ef80da2ca918f0d548ee54cc1cf5fdb56b0ef6c88bc160ce94474 +size 944859744 diff --git a/2B_or_not_2B.i1-IQ2_XXS.gguf b/2B_or_not_2B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..afb22a7 --- /dev/null +++ b/2B_or_not_2B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:534cdfa5d1e5b8fd34bea63f0923edcce62bebb153d5ecbbf89f399398ecf0da +size 885320288 diff --git a/2B_or_not_2B.i1-IQ3_M.gguf b/2B_or_not_2B.i1-IQ3_M.gguf new file mode 100644 index 0000000..7a7f870 --- /dev/null +++ b/2B_or_not_2B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:774771ea8502d50ae73cce0ea19449b8cb8163c182bf972c841dcdd9f336b24b +size 1308174944 diff --git a/2B_or_not_2B.i1-IQ3_S.gguf b/2B_or_not_2B.i1-IQ3_S.gguf new file mode 100644 index 0000000..d0a252a --- /dev/null +++ b/2B_or_not_2B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:76a48d309f6778bed094ca0cbb336af6d33ffd5b14bd6ae7ffcdf4edb48c5e14 +size 1289235040 diff --git a/2B_or_not_2B.i1-IQ3_XS.gguf b/2B_or_not_2B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..018e09a --- /dev/null +++ b/2B_or_not_2B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a5f4d225c7a5088f4b27e49c6e5ad6fafe01928be73f5c53207fde665fda5bbd +size 1244359264 diff --git a/2B_or_not_2B.i1-IQ3_XXS.gguf b/2B_or_not_2B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..e72bc23 --- /dev/null +++ b/2B_or_not_2B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:49946d29fa656666a41aa8338809a7c70819f8bb127b8ff68d52d5d703d22b88 +size 1125378656 diff --git a/2B_or_not_2B.i1-IQ4_XS.gguf b/2B_or_not_2B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..0077631 --- /dev/null +++ b/2B_or_not_2B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cfae2eb72b3fda7a8e22341e8fc69104c5e9d9633539796bf7203594068607a0 +size 1490733664 diff --git a/2B_or_not_2B.i1-Q2_K.gguf b/2B_or_not_2B.i1-Q2_K.gguf new file mode 100644 index 0000000..c055a63 --- /dev/null +++ b/2B_or_not_2B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80d41d529ca7c86b895911678b17cbdb0f1c7312a00e932b09b61e576f933acf +size 1157925472 diff --git a/2B_or_not_2B.i1-Q3_K_L.gguf b/2B_or_not_2B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..f1b8f14 --- /dev/null +++ b/2B_or_not_2B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aaab6f1fe768bc095f91cacf7bb6f074c7c679becf371bf8ff9f6858da079537 +size 1465592416 diff --git a/2B_or_not_2B.i1-Q3_K_M.gguf b/2B_or_not_2B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..ab03c02 --- /dev/null +++ b/2B_or_not_2B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2579be8c998129aeb4238603cea628c062f8f5ec0f658dd18da5ecbea1a1bc64 +size 1383803488 diff --git a/2B_or_not_2B.i1-Q3_K_S.gguf b/2B_or_not_2B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..43970d2 --- /dev/null +++ b/2B_or_not_2B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:64f7b668eb174fc9bf45e0f5468fa4b1944457b946532a0b1b8c0183f09535dd +size 1287981664 diff --git a/2B_or_not_2B.i1-Q4_0.gguf b/2B_or_not_2B.i1-Q4_0.gguf new file mode 100644 index 0000000..1c99ef7 --- /dev/null +++ b/2B_or_not_2B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c4a345d3622cfa75c34d140417a4a09fe0c4b3fd504d9d50800df808bebd3b11 +size 1555384928 diff --git a/2B_or_not_2B.i1-Q4_K_M.gguf b/2B_or_not_2B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..6e3ab05 --- /dev/null +++ b/2B_or_not_2B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9ed9df130166648c0b05c4a4f79c25ddfe209baedc0acd90516f67f97bbd2a04 +size 1630263904 diff --git a/2B_or_not_2B.i1-Q4_K_S.gguf b/2B_or_not_2B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..8ee6186 --- /dev/null +++ b/2B_or_not_2B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:329d44a01e20430eadd47d7b73400626d45849f66b091b71615bb180b649b8b2 +size 1559841376 diff --git a/2B_or_not_2B.i1-Q5_K_M.gguf b/2B_or_not_2B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..c7cfd8a --- /dev/null +++ b/2B_or_not_2B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:458b0a7c01cee45c5fddbbbe3620e7c242c6d5c0bb46d31fab49a07255b4a693 +size 1839651424 diff --git a/2B_or_not_2B.i1-Q5_K_S.gguf b/2B_or_not_2B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..f19e1d7 --- /dev/null +++ b/2B_or_not_2B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1244b11e8fe3c95fb2862da056e25e4ac35b1e6a8bb98c719925be2987a192c9 +size 1798916704 diff --git a/2B_or_not_2B.i1-Q6_K.gguf b/2B_or_not_2B.i1-Q6_K.gguf new file mode 100644 index 0000000..668d588 --- /dev/null +++ b/2B_or_not_2B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1bc4b4c506d6069e7a5436d7cb5f371c6771e437298304a6e26d8aeda87371b3 +size 2062125664 diff --git a/README.md b/README.md new file mode 100644 index 0000000..4475063 --- /dev/null +++ b/README.md @@ -0,0 +1,73 @@ +--- +base_model: SicariusSicariiStuff/2B_or_not_2B +language: +- en +library_name: transformers +license: gemma +quantized_by: mradermacher +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/SicariusSicariiStuff/2B_or_not_2B + + +static quants are available at https://huggingface.co/mradermacher/2B_or_not_2B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.9 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q2_K.gguf) | i1-Q2_K | 1.3 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.7 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.9 | | +| [GGUF](https://huggingface.co/mradermacher/2B_or_not_2B-i1-GGUF/resolve/main/2B_or_not_2B.i1-Q6_K.gguf) | i1-Q6_K | 2.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..95d1b94 --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8c610b21e8b2761fc7dac8096a59ac43091dde76939dc33a68c5dd81d1c4254b +size 2068543