初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Claria1.7b-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Claria1.7b.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Claria1.7b.i1-IQ1_M.gguf
Normal file
3
Claria1.7b.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c4b1ced4e76ce6d046640766a8780f64293062c9cd3adfb4c81a86b51ac01787
|
||||
size 543794368
|
||||
3
Claria1.7b.i1-IQ1_S.gguf
Normal file
3
Claria1.7b.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:64ff6aaa3f1ef72cb5a1d1b66077e6af180f40f7381e2aa9262fd4f318055a02
|
||||
size 515777728
|
||||
3
Claria1.7b.i1-IQ2_M.gguf
Normal file
3
Claria1.7b.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1d3a883f4d44eabcf74947f32c7be9d7571474ea6c663f4fa9b58fb36056d01c
|
||||
size 695182528
|
||||
3
Claria1.7b.i1-IQ2_S.gguf
Normal file
3
Claria1.7b.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:60b1e5c25d571430a1c10c165e0658e7dfcb1084bbce3acbe04c353f07c239f5
|
||||
size 657827008
|
||||
3
Claria1.7b.i1-IQ2_XS.gguf
Normal file
3
Claria1.7b.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2e4b487df0c7272dcf1c3d101d2a448bd73435cb5c44428127c281a5994a41fe
|
||||
size 631514304
|
||||
3
Claria1.7b.i1-IQ2_XXS.gguf
Normal file
3
Claria1.7b.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:de17fab48c6306440405325dbf2796e9d7d62a36ef7eecffa9b07549aea875ed
|
||||
size 590488768
|
||||
3
Claria1.7b.i1-IQ3_M.gguf
Normal file
3
Claria1.7b.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:23daba269313e756ace06c9c45005cefc6dc0cdf9495e248e96f0586d1b4c5f4
|
||||
size 895663296
|
||||
3
Claria1.7b.i1-IQ3_S.gguf
Normal file
3
Claria1.7b.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3cf37844cd59f9277e1ad82b9b4de9bc1aa72a106527cc947b2dcb66d65f2a35
|
||||
size 867253440
|
||||
3
Claria1.7b.i1-IQ3_XS.gguf
Normal file
3
Claria1.7b.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ba1eb148cca9d939f8af662d1fdb8dcf2910d6aa4e1a1cc21cedfb1f17b41c10
|
||||
size 834223296
|
||||
3
Claria1.7b.i1-IQ3_XXS.gguf
Normal file
3
Claria1.7b.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e5cd76433a59dbb9113a639d47bcbc7ab179c5c69fe19ff823153279fb675b73
|
||||
size 754361536
|
||||
3
Claria1.7b.i1-IQ4_NL.gguf
Normal file
3
Claria1.7b.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:62abcac7e4620f3dd3817914355bc04fda028aeb6dc4e54bfc4aa6a099d4758a
|
||||
size 1054424256
|
||||
3
Claria1.7b.i1-IQ4_XS.gguf
Normal file
3
Claria1.7b.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7d870b6a084a9ebbf4ce774ba10e6b7d7ea508e4429e12b70d2f2ebb70c6b132
|
||||
size 1010384064
|
||||
3
Claria1.7b.i1-Q2_K.gguf
Normal file
3
Claria1.7b.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1c5de165d11181784f92422c36b619d0fa343a58c3ec048f25f50e1f52f14a8
|
||||
size 777796800
|
||||
3
Claria1.7b.i1-Q2_K_S.gguf
Normal file
3
Claria1.7b.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a5d2e84a7ee436b3290c8b34a02e654ec265323b9cac55416c9360675bbb5361
|
||||
size 732970176
|
||||
3
Claria1.7b.i1-Q3_K_L.gguf
Normal file
3
Claria1.7b.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:85c3655be24c6c0e1674ab700abddaaa3435b58cf75e5102bcb8f6280481f44b
|
||||
size 1003502784
|
||||
3
Claria1.7b.i1-Q3_K_M.gguf
Normal file
3
Claria1.7b.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9dd2863e90f99cf7c770fe42df50c14312e9151dc09a399778dacd5d68a6e51c
|
||||
size 939539648
|
||||
3
Claria1.7b.i1-Q3_K_S.gguf
Normal file
3
Claria1.7b.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e3fff6ba47f0bd2d17ec3872ee7e9b474eda173586dfe36536ab66d57142eb22
|
||||
size 867253440
|
||||
3
Claria1.7b.i1-Q4_0.gguf
Normal file
3
Claria1.7b.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:013cdc469277df333af6611c24db86dddc4078d6f5ae7d65e031d33a12a4da43
|
||||
size 1056783552
|
||||
3
Claria1.7b.i1-Q4_1.gguf
Normal file
3
Claria1.7b.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5f98ac0552b81742701f3c712deb159d0b143c565862e8bc033efbd933fb85ae
|
||||
size 1142504640
|
||||
3
Claria1.7b.i1-Q4_K_M.gguf
Normal file
3
Claria1.7b.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f1fdee25ae09bd3de642c0d68ff7041ecc0274f1e539bd138e4607baf1aecaa7
|
||||
size 1107410112
|
||||
3
Claria1.7b.i1-Q4_K_S.gguf
Normal file
3
Claria1.7b.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dbbfb4a0485b4942db3724515ba088ccc4d9e271088861c5125bfeee7563fd84
|
||||
size 1060191424
|
||||
3
Claria1.7b.i1-Q5_K_M.gguf
Normal file
3
Claria1.7b.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bfc414390e09f5800b2bdb62a4a8075940f90156960d2859d9f8459e6db8531e
|
||||
size 1257880768
|
||||
3
Claria1.7b.i1-Q5_K_S.gguf
Normal file
3
Claria1.7b.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0de83c8761f7377d8e854fb89bfc4eb2e87582f5a03833c3b6e9f65d91e1e9f9
|
||||
size 1230585024
|
||||
3
Claria1.7b.i1-Q6_K.gguf
Normal file
3
Claria1.7b.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f8f3110bdbfbef1a2108b8f10e9c6382659ef336996afcf750e27aceecd872cd
|
||||
size 1417755840
|
||||
89
README.md
Normal file
89
README.md
Normal file
@@ -0,0 +1,89 @@
|
||||
---
|
||||
base_model: drwlf/Claria1.7b
|
||||
language:
|
||||
- en
|
||||
- ro
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- text-generation-inference
|
||||
- transformers
|
||||
- unsloth
|
||||
- qwen3
|
||||
- trl
|
||||
- sft
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
weighted/imatrix quants of https://huggingface.co/drwlf/Claria1.7b
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Claria1.7b-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/Claria1.7b-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Claria1.7b-i1-GGUF/resolve/main/Claria1.7b.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
3
imatrix.dat
Normal file
3
imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:07bf0a68f8915637076afc93749b5e67a8759b7d203ffdc094b2526667d8c112
|
||||
size 2070873
|
||||
Reference in New Issue
Block a user