初始化项目，由ModelHub XC社区提供模型
Model: mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
59
.gitattributes
vendored
Normal file
59
.gitattributes
vendored
Normal file
@@ -0,0 +1,59 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:327e340bdeab66bba2d8fe3563e4eb8d82fb14fd4f63d6f83a4c7e0eb55d80b9
|
||||
size 5750496704
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:595cb3e506d40ad58f4f326ed2a27541573d0461baddddb41636743642a2de3a
|
||||
size 5273722304
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a5d7cd9c1d4d4d5bdd6c655a87ca1e4438e1125d183897ad9ef4c56f66539d2d
|
||||
size 8114052544
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b2bdc3214120c350d5883ad45b4e3de7d41863f4ed1e241dcaee9d8339446421
|
||||
size 7478353344
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cb8bc86d99e81c15fef8702381cb415548fb58c890573707277e124cc3764e4b
|
||||
size 7207034304
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8836134ffd7c3e05276920a6460698635296d0ad11d2fb8a7967f3f58326c1bc
|
||||
size 6545120704
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b3bffd85b6e09fa47add3093c90eb3e1b86f793e9c487119b41f529642cbeb3d
|
||||
size 10650951104
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c4d06d201b0244df575ec60634f0c580fc4e744cb6a80ace6b7637ff7563cc9d
|
||||
size 10428128704
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4cab4cc7075642dcece3eed275015c3c29f507837b2128208048525e51dcf0b6
|
||||
size 9907117504
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1b5fc1c291edd776e356b28cde6678a4a3fccf78bbe9eca956fcc84450a0e277
|
||||
size 9280593344
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f19e21744bcfc9b0e2fa00f570dcfc374a683d6eb32adad5e74c51a5073c3263
|
||||
size 12758916544
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3e4f266adffb4388e977979feb0295342c43b684202ff022d56d12e3f4bb92ff
|
||||
size 8890326464
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:15980b34374aedbfa6e7a87669302ffe06ee1ad275ee0cdaa2063c86436edba6
|
||||
size 8320163264
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4b03bb6431b8b7e0dca153ab232fafa12ca475e3a7b1474b9f056ef3681c24ac
|
||||
size 12400762304
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:173a49e36974c42cc9d1eae2e73f2a51c96c17411a640ef790495637d0c54c81
|
||||
size 11474083264
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:77ff9bbc858e1adbe53eeb1335d69ad67b29877859f0a026d032448b91aa268b
|
||||
size 10400275904
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5cc56fd41dafc31bd8dee059be6c196695b1474d52967f65c67c0606d76c39e1
|
||||
size 13494230464
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3595e1009d1c5456e16cc75b95e6e8c3eddc94a396bfb6b0a00f3ec2f220b5e8
|
||||
size 14873107904
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:39a25089dbc629fd9b96873744c7ac4adc7eb14b9f107dc51bdcc90b01a63953
|
||||
size 14333910464
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:045935e7112e8cbf46e16902f8f578569d69ce7e7c46cde6e4418728d068052f
|
||||
size 13549280704
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:79481ebc1c8a16a1a5d8566c05f8720da886eb3ad7976f8d7b21f61289682246
|
||||
size 16763985344
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2288eaac290860408c99943aa5da3676b26fd7cfb58f050d77de32da36b7b25c
|
||||
size 16304414144
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:77da7270ea677d19f5d99b783a916a5d4d74ffb71e21854ab92efebb151fe654
|
||||
size 19345939904
|
||||
87
README.md
Normal file
87
README.md
Normal file
@@ -0,0 +1,87 @@
|
||||
---
|
||||
base_model: sleepdeprived3/NonDenominational-Christian-Bible-Expert-v2.0-24B
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- Christian
|
||||
- Bible
|
||||
- Theology
|
||||
- Jesus
|
||||
- Non-Denominational
|
||||
- Evangelical
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/sleepdeprived3/NonDenominational-Christian-Bible-Expert-v2.0-24B
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ1_S.gguf) | i1-IQ1_S | 5.4 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ1_M.gguf) | i1-IQ1_M | 5.9 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 6.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 7.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_S.gguf) | i1-IQ2_S | 7.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ2_M.gguf) | i1-IQ2_M | 8.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 8.4 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q2_K.gguf) | i1-Q2_K | 9.0 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 9.4 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 10.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 10.5 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_S.gguf) | i1-IQ3_S | 10.5 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ3_M.gguf) | i1-IQ3_M | 10.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 11.6 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 12.5 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 12.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_0.gguf) | i1-Q4_0 | 13.6 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 13.6 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 14.4 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q4_1.gguf) | i1-Q4_1 | 15.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 16.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 16.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/NonDenominational-Christian-Bible-Expert-v2.0-24B-i1-GGUF/resolve/main/NonDenominational-Christian-Bible-Expert-v2.0-24B.i1-Q6_K.gguf) | i1-Q6_K | 19.4 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:50cea15832f08387b2236e9937e499ff4f2ecc8156bf2dcd537c6c0c377d4480
|
||||
size 10003525
|
||||
Reference in New Issue
Block a user