初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF Source: Original Platform
This commit is contained in:
59
.gitattributes
vendored
Normal file
59
.gitattributes
vendored
Normal file
@@ -0,0 +1,59 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e77f537160106090ba123a4be05c037a21801d1c5ed574c1ec522d721569d680
|
||||
size 924190016
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dd6b8825be838d5e9c5738d08871a90d891ce768fe537b3c6e311cf698b7ab96
|
||||
size 868156736
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6ba95be37189e264f614df107772133ae138420f99b5f27b1a424b44c1667931
|
||||
size 1229030720
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5553704e1656c463aa5cc97d949dcd3e8002c756aa014b37870611261d708d0b
|
||||
size 1154319680
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XS.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:53ebf3a531ec6dc98a5899cd71a41bafd9528287fe7f267741bfa6cfa386fdde
|
||||
size 1100547392
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XXS.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5921c977b3c1cfa36ae70fdfc342db5994e4f8ba9c67ca728a54e927b16dce44
|
||||
size 1017578816
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:53d8061cb64443253381d02ad53e2f08f9d0cf731919c5bfd8d5b1aded461258
|
||||
size 1599667520
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:19144b213fbb7c807fdebfdd756d675ae07741c4cb767be1ade13901d68055b4
|
||||
size 1542847808
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XS.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:39662bc06ace15da900ef43f40ae9243cc48a985d1624f208bb9b6b8e7d061cb
|
||||
size 1476787520
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XXS.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:396fd240afc3a9f3c8eff3ff2a40a1bf6969432cd793c11c1540b33f4d813b1b
|
||||
size 1348764992
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_NL.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:47be607c2b10769484a69f4ca68dc8ac291695c5cea77373da378fbffb9cbe68
|
||||
size 1917189440
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_XS.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:222e6014940950580898c3f760384105236e9b657976d8c55dd08352ae8a8b51
|
||||
size 1829109056
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2fad79b232d2244135ce3873cfdc2074d7479ac907882fa3fcc4f2eb195850fc
|
||||
size 1363934528
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fb26560694cf24cccdc349e0e975aa27ef886d6bee32291e2b9d48dbe46e2df6
|
||||
size 1274281280
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_L.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:13dea4861cca8ad5e93e6ed4d8b40e86624d72a25deaf1489540547053e8bd07
|
||||
size 1815346496
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:be3f535ad0dc2c3270d5e553e2a5b9fbf88ea3e3f4c0ca7da99f6244ff042eef
|
||||
size 1687158080
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5c0a6416458f2b9f13e3056570cbc74247daf574985e9033a282cded915b1602
|
||||
size 1542847808
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_0.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:78c1d8b67d3ff7b0237394e5d5596759742b0dd5331baa83a998d4c7e634a114
|
||||
size 1921908032
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_1.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:977104d10c6e58a7fdb125e84698b11eeb5e4dc7ffe8f64a17f43a83305af5a7
|
||||
size 2093350208
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fca898dc1fb4f052703e0beb3335f17d207b93cd4b8d425f17470ded278caa86
|
||||
size 2019376448
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4d4fcd04bf28d2d8095b27ded268b4ecf83e05e078abdeb61589f06b9708643b
|
||||
size 1928199488
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_M.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9bc58aade1ed3b81d88f028f982bdfb7af193bfaf1de342229a65cda63955118
|
||||
size 2322152768
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_S.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:47f85769f9747d72643be3d849750c6619f46581ea161b810ce3593956eb575e
|
||||
size 2269510976
|
||||
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q6_K.gguf
Normal file
3
JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:74ce723b5d60a391be05f50de72ac921901f82af62f96a8089002337221322fc
|
||||
size 2643852608
|
||||
94
README.md
Normal file
94
README.md
Normal file
@@ -0,0 +1,94 @@
|
||||
---
|
||||
base_model: RezVortex/JAJUKA-WEWILLNEVERFORGETYOU-3B
|
||||
datasets:
|
||||
- Replete-AI/Apocrypha
|
||||
- KingNish/reasoning-base-20k
|
||||
- lunahr/thea-name-overrides
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- roleplay
|
||||
- rp
|
||||
- not-for-all-audiences
|
||||
- conversational
|
||||
- textgeneration
|
||||
- text2text
|
||||
- storyteller
|
||||
- cute
|
||||
- amazing
|
||||
- lovely
|
||||
- "i❤️\U0001F525jajuka"
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/RezVortex/JAJUKA-WEWILLNEVERFORGETYOU-3B
|
||||
|
||||
<!-- provided-files -->
|
||||
static quants are available at https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.0 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.9 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.0 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_0.gguf) | i1-Q4_0 | 2.0 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.0 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.1 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/JAJUKA-WEWILLNEVERFORGETYOU-3B-i1-GGUF/resolve/main/JAJUKA-WEWILLNEVERFORGETYOU-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.7 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user