29 lines
1.0 KiB
Markdown
29 lines
1.0 KiB
Markdown
---
|
|
base_model: uaebn/leesplank-municipal
|
|
library_name: gguf
|
|
quantized_by: uaebn
|
|
license: apache-2.0
|
|
tags:
|
|
- gguf
|
|
- quantization
|
|
- text-generation
|
|
- llama.cpp
|
|
- lm-studio
|
|
---
|
|
|
|
# GGUF Quantized: leesplank-municipal
|
|
|
|
This repository contains GGUF format model files for [uaebn/leesplank-municipal](https://huggingface.co/uaebn/leesplank-municipal).
|
|
|
|
Due to a tokenizer compatibility issue between this model family and llama.cpp's GGUF format, some complex Dutch compound words may be truncated during generation.
|
|
If you'd like to use this model, use the safetensors model.
|
|
## Files Available
|
|
|
|
| Filename | Quant Type | Size | Description |
|
|
|:--- |:--- |:--- |:--- |
|
|
| **leesplank-municipal.Q4_K_M.gguf** | Q4_K_M | 1.05 GB | **Recommended.** Balanced quality and speed. Best for most standard laptops (8GB+ RAM). |
|
|
| **leesplank-municipal.Q5_K_M.gguf** | Q5_K_M | 1.20 GB | **High Quality.** Slight accuracy increase over Q4, but uses more RAM. |
|
|
| **leesplank-municipal.f16.gguf** | F16 | 3.32 GB | **Uncompressed.** Maximum precision. |
|
|
|
|
---
|