auto-patch README.md
This commit is contained in:
committed by
system
parent
1433aa1d44
commit
745b36a748
@@ -43,6 +43,7 @@ more details, including on how to concatenate multi-part files.
|
||||
| Link | Type | Size/GB | Notes |
|
||||
|:-----|:-----|--------:|:------|
|
||||
| [GGUF](https://huggingface.co/mradermacher/Warlock-7B-v3-Uncensored-i1-GGUF/resolve/main/Warlock-7B-v3-Uncensored.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
|
||||
| [GGUF](https://huggingface.co/mradermacher/Warlock-7B-v3-Uncensored-i1-GGUF/resolve/main/Warlock-7B-v3-Uncensored.i1-Q2_K.gguf) | i1-Q2_K | 2.8 | IQ3_XXS probably better |
|
||||
|
||||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||||
types (lower is better):
|
||||
|
||||
Reference in New Issue
Block a user