mradermacher/jais-family-13b-chat-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/jais-family-13b-chat-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-30 23:03:19 +08:00
commit 9b464b7959
26 changed files with 215 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
jais-family-13b-chat.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: inceptionai/jais-family-13b-chat
language:
- ar
- en
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
tags:
- Arabic
- English
- LLM
- Decoder
- causal-lm
- jais-family
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/inceptionai/jais-family-13b-chat
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/jais-family-13b-chat-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ1_S.gguf) | i1-IQ1_S | 4.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ1_M.gguf) | i1-IQ1_M | 4.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 4.7 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ2_XS.gguf) | i1-IQ2_XS | 5.0 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ2_S.gguf) | i1-IQ2_S | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ2_M.gguf) | i1-IQ2_M | 5.4 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q2_K_S.gguf) | i1-Q2_K_S | 5.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q2_K.gguf) | i1-Q2_K | 5.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 6.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ3_XS.gguf) | i1-IQ3_XS | 6.2 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ3_S.gguf) | i1-IQ3_S | 6.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q3_K_S.gguf) | i1-Q3_K_S | 6.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ3_M.gguf) | i1-IQ3_M | 7.0 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q3_K_M.gguf) | i1-Q3_K_M | 7.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ4_XS.gguf) | i1-IQ4_XS | 7.5 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q3_K_L.gguf) | i1-Q3_K_L | 7.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-IQ4_NL.gguf) | i1-IQ4_NL | 7.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q4_0.gguf) | i1-Q4_0 | 7.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q4_K_S.gguf) | i1-Q4_K_S | 8.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q4_1.gguf) | i1-Q4_1 | 8.6 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q4_K_M.gguf) | i1-Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q5_K_S.gguf) | i1-Q5_K_S | 9.6 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q5_K_M.gguf) | i1-Q5_K_M | 10.5 | |
| [GGUF](https://huggingface.co/mradermacher/jais-family-13b-chat-i1-GGUF/resolve/main/jais-family-13b-chat.i1-Q6_K.gguf) | i1-Q6_K | 11.8 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
jais-family-13b-chat.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17ecfb21446b497f3d2fbe97c5577dc1ac0619f817d980c0eae2b9bfb38f8c2b
size 4214896992

3
jais-family-13b-chat.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cea3a9ce962a5b01b091f2e05041bb4a275bb3f9ff4ac9ee1d7e991e0e064467
size 4009994592

3
jais-family-13b-chat.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:49e91f7da627f0110b1f42f113fd0e016c7cf79a745ae58decdb91d420aa89c4
size 5327227232

3
jais-family-13b-chat.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:abdde5f13418602d270dc9a528fb0546dd525a121fd5f0271633f360056ca91e
size 5054024032

3
jais-family-13b-chat.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:972afe6cb18b38fbaf6119b4903c1dcc7de9351c3ba228a7cbde6b77094ae6d7
size 4862372192

3
jais-family-13b-chat.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e222c2952b23604a71ca8fda8b5e2f2f7059ab5a440d77dffd0d094b45497037
size 4556400992

3
jais-family-13b-chat.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:be86250d860a6adbaa779c5af3e980d12cbda5471683f3318c8dc6f2b91e7386
size 6942013792

3
jais-family-13b-chat.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec3fafb61b84b66947d63fc8b486b9bc578c0a73ace2121a3f9906fafdf0178e
size 6341232992

3
jais-family-13b-chat.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65141c2dabb4fb5a9b75db84196bb6b779e1ae4a7e62408e4ba2414f2facac63
size 6144471392

3
jais-family-13b-chat.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eddb21cd4186ff3d01a21f5133135b4b6b5000638533cbf17fe21408f13f71f8
size 5873633632

3
jais-family-13b-chat.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2ffb1be6b3064ab35b305062b63350e285a16b8ee17fd7e8054a90e8e463f3f
size 7699405152

3
jais-family-13b-chat.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:367c6503626dab0514b30617aadb7eb99af576f4f2f6ec69f93388730a32e60a
size 7379835232

3
jais-family-13b-chat.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd78f236fb08560a7a2b478c5e3cbdda74e1b62fb64a73eebdf7d94d85f2bcd3
size 5409126752

3
jais-family-13b-chat.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b70505874ace021e8a672c2cb8a41dad6d33bf64c90196f2eb04b4b0e82ac94
size 5346355552

3
jais-family-13b-chat.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59ce3ab1c33ce3b1ffe7b87f72bd0611677f16f0b4eb395ae9a5ede9eda2a038
size 7554058592

3
jais-family-13b-chat.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d6d5c5338a0a82600c3ce08ebafc52065a5edd2a30cb70dcf26f6e10dfd13ea3
size 7256832352

3
jais-family-13b-chat.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ba1f59b7570da19c2bc433b0769579688a04e71b8acdb4da2fa031fa927264ba
size 6341232992

3
jais-family-13b-chat.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f936c205ebaa3a30407f15b35be5b6d1f76863dfb46c9cb9be2dade89613cdfb
size 7721267552

3
jais-family-13b-chat.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4f5dcd84813bc2957e46fe77509993d04326cd23dac3796af595959e0ab9d516
size 8513444192

3
jais-family-13b-chat.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2a8d2f4fec8c5574ea0950337b45b06efacf1377e10d5049029a3e7979cf5f29
size 8967117152

3
jais-family-13b-chat.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:022d79c24e234d6f3475379d06d626d532c9469fe8a372870d0b814f87f4e9d4
size 8071065952

3
jais-family-13b-chat.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d439422624ddf8a015c29d1e5c6e6651033154e8266b9cf54f1dbaaed28dffde
size 10357422432

3
jais-family-13b-chat.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7626e497b21a83c4243d69cc9157259b9aa2c1edd725e99eb218d99b12a283ea
size 9502382432

3
jais-family-13b-chat.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26194f6a49bb926b7a5d0be4d5042491b975ab21955a4db5560efb172b1d5e78
size 11735050592