commit 05c1a7d1df08f6d03d1076e9a793bf1299b3a6f4 Author: ModelHub XC Date: Tue May 19 17:12:14 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..d5f2147 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,60 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +imatrix.dat filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text +Christian-Bible-Expert-v2.0-12B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ1_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ1_M.gguf new file mode 100644 index 0000000..bab5a42 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ1_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:68f1730fb3feca97e7c4a42a86a0877d26d0073fd397eaf667711d18edc60ec8 +size 3221628544 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ1_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ1_S.gguf new file mode 100644 index 0000000..b22cd3e --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:78728dc3dac96c64b1a53705ca0772ce2c91ce53c51f6ed5cc87be82c2a09b99 +size 2999215744 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ2_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_M.gguf new file mode 100644 index 0000000..2ae400d --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b75c35127ccba7e7dba297f9fc4d1c0ebdb6fb9e736a3d2bff6e4d3f15d1f9d7 +size 4435027584 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ2_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_S.gguf new file mode 100644 index 0000000..acdd7f6 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:abb6c6b0cfadbc7fedf0a3e15d20893dc460cdbb3ec640941f8d2e10abc59bdd +size 4138477184 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XS.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XS.gguf new file mode 100644 index 0000000..d26d789 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:372bf217a865c12f93f83df3edbf1727d66efb6f4fc476483cd69936ee6b0a10 +size 3915081344 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XXS.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XXS.gguf new file mode 100644 index 0000000..a3e69af --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4105bfbc5208e6e9bf610542c3d2573342fd1ff26c19c971682cd0a41ba8b61c +size 3592316544 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ3_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_M.gguf new file mode 100644 index 0000000..5d96a40 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:be6288ebad81107cbfc0c926083cb6ed2517ffb0385b453d7056fa4f82b11dab +size 5722236544 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ3_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_S.gguf new file mode 100644 index 0000000..3f738f8 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ef6577132126c6fbae0eaafd4f4018a7b8d7037aac01edc765d1ea0555551ebe +size 5562082944 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XS.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XS.gguf new file mode 100644 index 0000000..b91facc --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:71d58e09e47add8fa13d6cd47f14946196968a05869a9cd5afcb6004cfc83e03 +size 5306492544 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XXS.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XXS.gguf new file mode 100644 index 0000000..bdb4fbb --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XXS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:704b5c5f879afbba172f81d0220b0cb998784429eb0185373a03ec39f6085182 +size 4945389184 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ4_NL.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ4_NL.gguf new file mode 100644 index 0000000..b485cb1 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ4_NL.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:07099e2bc0241347f90d60e6c01a7cae7d86a51a63c88ffca6b07ddc019645e1 +size 7097919104 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-IQ4_XS.gguf b/Christian-Bible-Expert-v2.0-12B.i1-IQ4_XS.gguf new file mode 100644 index 0000000..e7bfe95 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-IQ4_XS.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c046515f9532bec414e85f367e017ac76536f8275bc2844306897a283b28272 +size 6742713984 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q2_K.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q2_K.gguf new file mode 100644 index 0000000..258cce2 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fd908f6a46033d5fe49004b7e4985b71075ba4ee7141490fc3e94f573407c8fa +size 4791051904 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q2_K_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q2_K_S.gguf new file mode 100644 index 0000000..3b25d78 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q2_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eec4813b2080448b10152fcc0c83c1bef49eb80fd2e2bafa2ae0bad88599e674 +size 4493682304 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_L.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_L.gguf new file mode 100644 index 0000000..4fc48da --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:46bcfb87ee4e8ce12540f700221d803c8a4eba2876683022d25d94bc29a96a00 +size 6561506944 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_M.gguf new file mode 100644 index 0000000..4cb7b8c --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:698c594b4a222eb0f3333aa284988b5d3e76410fb306a62753db50c2fc8f667a +size 6083094144 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_S.gguf new file mode 100644 index 0000000..ff22e85 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:21d05da69e4b2a2ec0c51665571b9ffe26ef72ae4702e3e9a2c7336d0bdec1b5 +size 5534230144 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q4_0.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q4_0.gguf new file mode 100644 index 0000000..2337f3d --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4170f44e65d3da6dd75602aeef3aa0dfcafabc28bb673f10b3d23f338f193574 +size 7094642304 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q4_1.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q4_1.gguf new file mode 100644 index 0000000..697deac --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ee0a8715af2fa474bbf9c1da4c1606e07606460baef7afa427e9b819e0e2e1db +size 7795222144 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_M.gguf new file mode 100644 index 0000000..be6c995 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7668aa4a19afea751e67e28c95e5346866346ba0bcefc11a88a91f38b952f837 +size 7477208704 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_S.gguf new file mode 100644 index 0000000..26fb728 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6a45c13ae2c748e9c51b2785c5c10b0c705e7235aa6f94c9e9b76418b66f49f3 +size 7120201344 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_M.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_M.gguf new file mode 100644 index 0000000..f2e624b --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2c481d4cf2bce25b63268970759bf5fa916f957ffa4f33606c3f3ee9da8aa804 +size 8727635584 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_S.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_S.gguf new file mode 100644 index 0000000..9661ee7 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:eb6476abb71196c477240a87b36bc87eb76ae683734d59edec748460a051a9db +size 8518739584 diff --git a/Christian-Bible-Expert-v2.0-12B.i1-Q6_K.gguf b/Christian-Bible-Expert-v2.0-12B.i1-Q6_K.gguf new file mode 100644 index 0000000..f284519 --- /dev/null +++ b/Christian-Bible-Expert-v2.0-12B.i1-Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9e9c11541d12405c6180ad7ff193a6c2e74995336bb938908660bf5af696227 +size 10056214144 diff --git a/README.md b/README.md new file mode 100644 index 0000000..cf75deb --- /dev/null +++ b/README.md @@ -0,0 +1,88 @@ +--- +base_model: sleepdeprived3/Christian-Bible-Expert-v2.0-12B +language: +- en +library_name: transformers +license: apache-2.0 +mradermacher: + readme_rev: 1 +quantized_by: mradermacher +tags: +- Christian +- Bible +- Theology +- Jesus +- Non-Denominational +- Evangelical +--- +## About + + + + + + +weighted/imatrix quants of https://huggingface.co/sleepdeprived3/Christian-Bible-Expert-v2.0-12B + + + +***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Christian-Bible-Expert-v2.0-12B-i1-GGUF).*** + +static quants are available at https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-GGUF +## Usage + +If you are unsure how to use GGUF files, refer to one of [TheBloke's +READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for +more details, including on how to concatenate multi-part files. + +## Provided Quants + +(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants) + +| Link | Type | Size/GB | Notes | +|:-----|:-----|--------:|:------| +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ1_S.gguf) | i1-IQ1_S | 3.1 | for the desperate | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ1_M.gguf) | i1-IQ1_M | 3.3 | mostly desperate | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 3.7 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 4.0 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ2_S.gguf) | i1-IQ2_S | 4.2 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ2_M.gguf) | i1-IQ2_M | 4.5 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 4.6 | very low quality | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q2_K.gguf) | i1-Q2_K | 4.9 | IQ3_XXS probably better | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 5.0 | lower quality | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 5.4 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 5.6 | IQ3_XS probably better | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ3_S.gguf) | i1-IQ3_S | 5.7 | beats Q3_K* | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ3_M.gguf) | i1-IQ3_M | 5.8 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 6.2 | IQ3_S probably better | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 6.7 | IQ3_M probably better | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 6.8 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q4_0.gguf) | i1-Q4_0 | 7.2 | fast, low quality | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.2 | prefer IQ4_XS | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 7.2 | optimal size/speed/quality | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 7.6 | fast, recommended | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q4_1.gguf) | i1-Q4_1 | 7.9 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 8.6 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 8.8 | | +| [GGUF](https://huggingface.co/mradermacher/Christian-Bible-Expert-v2.0-12B-i1-GGUF/resolve/main/Christian-Bible-Expert-v2.0-12B.i1-Q6_K.gguf) | i1-Q6_K | 10.2 | practically like static Q6_K | + +Here is a handy graph by ikawrakow comparing some lower-quality quant +types (lower is better): + +![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png) + +And here are Artefact2's thoughts on the matter: +https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9 + +## FAQ / Model Request + +See https://huggingface.co/mradermacher/model_requests for some answers to +questions you might have and/or if you want some other model quantized. + +## Thanks + +I thank my company, [nethype GmbH](https://www.nethype.de/), for letting +me use its servers and providing upgrades to my workstation to enable +this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to. + + diff --git a/imatrix.dat b/imatrix.dat new file mode 100644 index 0000000..c63d90c --- /dev/null +++ b/imatrix.dat @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:6c04ca61fe228a8dea53e061d5c5060dcc471000bc2e9499807ddb2e37c90ac6 +size 7054405