初始化项目,由ModelHub XC社区提供模型
Model: mradermacher/Amoral.Extreme-1B-i1-GGUF Source: Original Platform
This commit is contained in:
60
.gitattributes
vendored
Normal file
60
.gitattributes
vendored
Normal file
@@ -0,0 +1,60 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Amoral.Extreme-1B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Amoral.Extreme-1B.i1-IQ1_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ1_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0c3e0cfa74644394df2c66a36e1d2ee7ccfc20c3dc524464e39e6598d8d47e54
|
||||||
|
size 643487296
|
||||||
3
Amoral.Extreme-1B.i1-IQ1_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e4973933a8f177b6215cdf2449217aa9ee7b2f43934766a9585436ddd394ff0b
|
||||||
|
size 639194944
|
||||||
3
Amoral.Extreme-1B.i1-IQ2_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ2_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8edc715f1b1c5243b00ab7609ed900522a7e3ca1fb684ef248ff0f1fcd264c67
|
||||||
|
size 669785152
|
||||||
3
Amoral.Extreme-1B.i1-IQ2_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ2_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:041489c6baccc4eac4c1a81af40c4c97f6a08c0d5a457c0541a060c00a174ddc
|
||||||
|
size 664062016
|
||||||
3
Amoral.Extreme-1B.i1-IQ2_XS.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e0d8527fdbf554b7ef43bd2bd22037d5e8a754321a18bb1ebb368f5aa9875b02
|
||||||
|
size 657322816
|
||||||
3
Amoral.Extreme-1B.i1-IQ2_XXS.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7533fbf9cb01075b0ab6251fa1f998adad3c1e541069e72fe184b05e062fc0a4
|
||||||
|
size 650641216
|
||||||
3
Amoral.Extreme-1B.i1-IQ3_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ3_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b374dd2f566b6d03750dc556f93cef2c374c205ec47c608d24ab5e064f46d61d
|
||||||
|
size 697062208
|
||||||
3
Amoral.Extreme-1B.i1-IQ3_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ3_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d99509930591da3ff8dc5d1cde02c71da54bb70e2d92c7b75b1d4b2ef2194d61
|
||||||
|
size 689816128
|
||||||
3
Amoral.Extreme-1B.i1-IQ3_XS.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7ead85b63e3db969b62f606b2b218808d189bcc03fbf8d3df534c9ca521856b5
|
||||||
|
size 689816128
|
||||||
3
Amoral.Extreme-1B.i1-IQ3_XXS.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:02bb346833eb2c35ee216ec82096fa659281e114367b655b6dbcc2ef17fd0f79
|
||||||
|
size 680111680
|
||||||
3
Amoral.Extreme-1B.i1-IQ4_NL.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b7d3bf2a3883335e8135dcfec17ce43917d23eaca2e2eb94d6e8dcde5e2fe53e
|
||||||
|
size 721864768
|
||||||
3
Amoral.Extreme-1B.i1-IQ4_XS.gguf
Normal file
3
Amoral.Extreme-1B.i1-IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:516e6db1ea74d2a15b0edb2b5bb61232af7fab12499d3853954fd8ebc1400486
|
||||||
|
size 714436672
|
||||||
3
Amoral.Extreme-1B.i1-Q2_K.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3dba15359f2a6ff2886154dd28f81352e48c0eae6320b3e7c53b2539c1960c70
|
||||||
|
size 689816128
|
||||||
3
Amoral.Extreme-1B.i1-Q2_K_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q2_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d6a3c7cbcb6edbb76c66630bc4a9ef749958595a07303b5be1993af31b18a462
|
||||||
|
size 671273536
|
||||||
3
Amoral.Extreme-1B.i1-Q3_K_L.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6f5ad527610cc86b84c7a3ba6460f33d5d4964d64862bda25b134494f19eabd6
|
||||||
|
size 751577152
|
||||||
3
Amoral.Extreme-1B.i1-Q3_K_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5a842c677be67095354cb1654f9370c150695038726d7f36ffac7db9c008e2af
|
||||||
|
size 722417728
|
||||||
3
Amoral.Extreme-1B.i1-Q3_K_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6b49e6ca332cfeeb2a7a9af8cba5aee59ebc94d43de2309b18df9903e19248f1
|
||||||
|
size 688857664
|
||||||
3
Amoral.Extreme-1B.i1-Q4_0.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8779de7df94c7db78926e0b92f77dbacb5d6390283779774cded5fa418e44cec
|
||||||
|
size 721920064
|
||||||
3
Amoral.Extreme-1B.i1-Q4_1.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d291889643e0c041c4d482a27a595062894f97fa9dd29e4913f7b7fcc5e2d274
|
||||||
|
size 764037184
|
||||||
3
Amoral.Extreme-1B.i1-Q4_K_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9eefc41f429ee6ab44c8e6f179b75da72b902fd9d9700ca1800c695fb3500380
|
||||||
|
size 806059840
|
||||||
3
Amoral.Extreme-1B.i1-Q4_K_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c6882aaa3f70fedf800f71278bf3f5a971b2be80a74d415ec0ed0bf1904194a1
|
||||||
|
size 780994624
|
||||||
3
Amoral.Extreme-1B.i1-Q5_K_M.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8596dfef6efe9301d44da6dc5211fb6aad0c0525e5e409da5e831b9c33eb28aa
|
||||||
|
size 851347264
|
||||||
3
Amoral.Extreme-1B.i1-Q5_K_S.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9928726ff5935826858478555ae1174b31256dff03aef924d392e86d200589be
|
||||||
|
size 836401216
|
||||||
3
Amoral.Extreme-1B.i1-Q6_K.gguf
Normal file
3
Amoral.Extreme-1B.i1-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6d3258e40ed0af6507037480285abb89d1fcf5ef35ebe15c429718578d6d4041
|
||||||
|
size 1011740224
|
||||||
3
Amoral.Extreme-1B.imatrix.gguf
Normal file
3
Amoral.Extreme-1B.imatrix.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e5636362df3ad5ef29a23abebcaa3becc6b4a164fa1b4bf1ea12d1a156215824
|
||||||
|
size 1452416
|
||||||
97
README.md
Normal file
97
README.md
Normal file
@@ -0,0 +1,97 @@
|
|||||||
|
---
|
||||||
|
base_model: NovaCorp/Amoral.Extreme-1B
|
||||||
|
datasets:
|
||||||
|
- TheDrummer/AmoralQA-v2
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- es
|
||||||
|
library_name: transformers
|
||||||
|
license: gemma
|
||||||
|
mradermacher:
|
||||||
|
readme_rev: 1
|
||||||
|
quantized_by: mradermacher
|
||||||
|
tags:
|
||||||
|
- mergekit
|
||||||
|
- merge
|
||||||
|
- 1b
|
||||||
|
- roleplay
|
||||||
|
- uncensored
|
||||||
|
- rp
|
||||||
|
- amoral
|
||||||
|
- not-for-all-audiences
|
||||||
|
---
|
||||||
|
## About
|
||||||
|
|
||||||
|
<!-- ### quantize_version: 2 -->
|
||||||
|
<!-- ### output_tensor_quantised: 1 -->
|
||||||
|
<!-- ### convert_type: hf -->
|
||||||
|
<!-- ### vocab_type: -->
|
||||||
|
<!-- ### tags: nicoboss -->
|
||||||
|
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
|
||||||
|
<!-- ### quants_skip: -->
|
||||||
|
<!-- ### skip_mmproj: -->
|
||||||
|
weighted/imatrix quants of https://huggingface.co/NovaCorp/Amoral.Extreme-1B
|
||||||
|
|
||||||
|
<!-- provided-files -->
|
||||||
|
|
||||||
|
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Amoral.Extreme-1B-i1-GGUF).***
|
||||||
|
|
||||||
|
static quants are available at https://huggingface.co/mradermacher/Amoral.Extreme-1B-GGUF
|
||||||
|
## Usage
|
||||||
|
|
||||||
|
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||||||
|
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||||||
|
more details, including on how to concatenate multi-part files.
|
||||||
|
|
||||||
|
## Provided Quants
|
||||||
|
|
||||||
|
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||||||
|
|
||||||
|
| Link | Type | Size/GB | Notes |
|
||||||
|
|:-----|:-----|--------:|:------|
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.7 | for the desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.7 | mostly desperate |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.8 | lower quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.8 | IQ3_XS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ3_S.gguf) | i1-IQ3_S | 0.8 | beats Q3_K* |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q2_K.gguf) | i1-Q2_K | 0.8 | IQ3_XXS probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ3_M.gguf) | i1-IQ3_M | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.8 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.8 | prefer IQ4_XS |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q4_0.gguf) | i1-Q4_0 | 0.8 | fast, low quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.8 | IQ3_S probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.9 | IQ3_M probably better |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q4_1.gguf) | i1-Q4_1 | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.9 | optimal size/speed/quality |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.9 | fast, recommended |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.9 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.0 | |
|
||||||
|
| [GGUF](https://huggingface.co/mradermacher/Amoral.Extreme-1B-i1-GGUF/resolve/main/Amoral.Extreme-1B.i1-Q6_K.gguf) | i1-Q6_K | 1.1 | practically like static Q6_K |
|
||||||
|
|
||||||
|
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||||
|
types (lower is better):
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
And here are Artefact2's thoughts on the matter:
|
||||||
|
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||||||
|
|
||||||
|
## FAQ / Model Request
|
||||||
|
|
||||||
|
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||||||
|
questions you might have and/or if you want some other model quantized.
|
||||||
|
|
||||||
|
## Thanks
|
||||||
|
|
||||||
|
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||||||
|
me use its servers and providing upgrades to my workstation to enable
|
||||||
|
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
|
||||||
|
|
||||||
|
<!-- end -->
|
||||||
Reference in New Issue
Block a user