初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/OPID-ALFWorld-1.7B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
OPID-ALFWorld-1.7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ1_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0afd465fb2529adb624d27715c07f75e54f232ecd6845bec61c867b62ebaf3e3
|
||||
size 645895200
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ1_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d8e5ed54c7ac9ff5c443298481fd2ecb69f7aacca97cb8a2b9d910bdbc0cc405
|
||||
size 617878560
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ2_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c76c898ac607460a66aca6fe8f324b0d2d8c81e9c8a97ec90db2278f88aa4ad1
|
||||
size 828886048
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ2_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:37f8d01f93e16f6b289c77eafc6284dbd0e1d7b3c1d5add830bd9c5503272bcf
|
||||
size 791530528
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ2_XS.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:994f2125814636a60a8cc5e53408826856dfbdb86fbdc060213fe9e23b27ef00
|
||||
size 733615136
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ2_XXS.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b2d305df2001c37a2c386a56e8a45bae7dd93abfe1d74c3caf52058e8cadc744
|
||||
size 692589600
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ3_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a3598f1ad45ae5c2e172e2568626a95bc9713661ce56bfa8c3e6274a52be5308
|
||||
size 1029366816
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ3_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:832d8d9d9cff0c5165309a0176499b4bf0c66ded8f10aa89ca0fcced390c858a
|
||||
size 1000956960
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ3_XS.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:318662b3b7b70259cc89306a225d0799692a606a14aba41b52a72d84e1f5453f
|
||||
size 967926816
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ3_XXS.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:365bf7781e5b48e82fb39df7d8dcb052af64883078646ca6c60ad8a3d3d21cb6
|
||||
size 888065056
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ4_NL.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6bdce88d671240cefdd14c815feecd0ecb201b1686f5c9c6f5b0315149863284
|
||||
size 1229454368
|
||||
3
OPID-ALFWorld-1.7B.i1-IQ4_XS.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0a82c8a4e9fdf4f1d933a16348208ac1ad16c3946a5173ce03c380a7527b0560
|
||||
size 1175690272
|
||||
3
OPID-ALFWorld-1.7B.i1-Q2_K.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:638e463af795cc61e40776eea88007de05e65f1ec2e7a1aa63c34d5b56761013
|
||||
size 879897632
|
||||
3
OPID-ALFWorld-1.7B.i1-Q2_K_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ce1e154a6b51906af0c6f1c5b63cef76787934f06a4b37745b3d89b1c98b941b
|
||||
size 835071008
|
||||
3
OPID-ALFWorld-1.7B.i1-Q3_K_L.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:35ff28cb8ed1a7998d8d44e4898094c6a88ff45b4de24ac5eac0d9e2cf1d561d
|
||||
size 1137206304
|
||||
3
OPID-ALFWorld-1.7B.i1-Q3_K_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5c297d225cad2501800f6eed1696fb8415894ea8675bb74a1686d66c506ffa46
|
||||
size 1073243168
|
||||
3
OPID-ALFWorld-1.7B.i1-Q3_K_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9375f93bdef00b76ed2b50531284c18e745788c810c33431797a08613c224e1e
|
||||
size 1000956960
|
||||
3
OPID-ALFWorld-1.7B.i1-Q4_0.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ee654c38c7d207645a5c0b6904cd36fb46267053e6e211d7d04310228d490064
|
||||
size 1231813664
|
||||
3
OPID-ALFWorld-1.7B.i1-Q4_1.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4c7d4c44050c1b8d0c27f3e3234e28b7080dead100a989524c3860a119c9ccc9
|
||||
size 1336982560
|
||||
3
OPID-ALFWorld-1.7B.i1-Q4_K_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:11d73139ded3bccec48c25673582fd59323b09de15a2508709a896f3fbb3fd08
|
||||
size 1282440224
|
||||
3
OPID-ALFWorld-1.7B.i1-Q4_K_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:124ba7a6657195560dd32ac36a9bca32369930a98433165f8fb76667b2b38304
|
||||
size 1235221536
|
||||
3
OPID-ALFWorld-1.7B.i1-Q5_K_M.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8f626735f635afb078a691e281a86e3f5971b05877c4f787b69547579964de56
|
||||
size 1471806496
|
||||
3
OPID-ALFWorld-1.7B.i1-Q5_K_S.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ce4530fea2c803b85d0573118c990d29e5132db61065d340c88c7ce1b3fc684b
|
||||
size 1444510752
|
||||
3
OPID-ALFWorld-1.7B.i1-Q6_K.gguf
Normal file
3
OPID-ALFWorld-1.7B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8561a98871ccd9986ad44ff33e221e1df9a26c2f46b77934b2c77eed76194983
|
||||
size 1673008160
|
||||
3
OPID-ALFWorld-1.7B.imatrix.gguf
Normal file
3
OPID-ALFWorld-1.7B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:382828f5a3fb6294739eb3966ce209a210a75c60620ebaa357ab0d14ab134f0f
|
||||
size 2094560
|
||||
94
README.md
Normal file
94
README.md
Normal file
@@ -0,0 +1,94 @@
|
||||
---
|
||||
base_model: Jinyang23/OPID-ALFWorld-1.7B
|
||||
language:
|
||||
- en
|
||||
library_name: transformers
|
||||
license: mit
|
||||
mradermacher:
|
||||
readme_rev: 1
|
||||
quantized_by: mradermacher
|
||||
tags:
|
||||
- agent
|
||||
- reinforcement-learning
|
||||
- long-horizon
|
||||
- embodied-ai
|
||||
- skill-distillation
|
||||
- alfworld
|
||||
- opid
|
||||
- qwen3
|
||||
---
|
||||
## About
|
||||
|
||||
<!-- ### quantize_version: 2 -->
|
||||
<!-- ### output_tensor_quantised: 1 -->
|
||||
<!-- ### convert_type: hf -->
|
||||
<!-- ### vocab_type: -->
|
||||
<!-- ### tags: nicoboss -->
|
||||
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||
<!-- ### quants_skip: -->
|
||||
<!-- ### skip_mmproj: -->
|
||||
weighted/imatrix quants of https://huggingface.co/Jinyang23/OPID-ALFWorld-1.7B
|
||||
|
||||
<!-- provided-files -->
|
||||
|
||||
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#OPID-ALFWorld-1.7B-i1-GGUF).***
|
||||
|
||||
static quants are available at https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-GGUF
|
||||
## Usage
|
||||
|
||||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||
more details, including on how to concatenate multi-part files.
|
||||
|
||||
## Provided Quants
|
||||
|
||||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.9 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.9 | very low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q2_K.gguf) | i1-Q2_K | 1.0 | IQ3_XXS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.0 | lower quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.1 | beats Q3_K* |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.1 | IQ3_XS probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.1 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.2 | IQ3_S probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.2 | IQ3_M probably better |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.3 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.3 | prefer IQ4_XS |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q4_0.gguf) | i1-Q4_0 | 1.3 | fast, low quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.3 | optimal size/speed/quality |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.4 | fast, recommended |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q4_1.gguf) | i1-Q4_1 | 1.4 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.5 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.6 | |
|
||||
| [GGUF](https://huggingface.co/mradermacher/OPID-ALFWorld-1.7B-i1-GGUF/resolve/main/OPID-ALFWorld-1.7B.i1-Q6_K.gguf) | i1-Q6_K | 1.8 | practically like static Q6_K |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||

|
||||
|
||||
And here are Artefact2's thoughts on the matter:
|
||||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||
|
||||
## FAQ / Model Request
|
||||
|
||||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||
questions you might have and/or if you want some other model quantized.
|
||||
|
||||
## Thanks
|
||||
|
||||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||
me use its servers and providing upgrades to my workstation to enable
|
||||
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||
|
||||
<!-- end -->
|
||||
Reference in New Issue
Block a user