language, license, library_name, tags, inference, pipeline_tag, base_model, base_model_relation
language license library_name tags inference pipeline_tag base_model base_model_relation
multilingual
pl
en
apache-2.0 gguf
gguf
quantization
false text-generation speakleash/Bielik-PL-11B-v3.0-Instruct quantized

Bielik-PL-11B-v3.0-Instruct-GGUF

This repository contains community-quantized GGUF files for the Bielik-PL-11B-v3.0-Instruct model by SpeakLeash.

The distinctive feature of this "-PL-" version is the optimized tokenizer (APT4) specifically dedicated to the Polish language.

Available formats:

  • Bielik-PL-11B-v3.0-Instruct.f16.gguf
  • Bielik-PL-11B-v3.0-Instruct.bf16.gguf
  • Bielik-PL-11B-v3.0-Instruct.Q8_0.gguf
  • Bielik-PL-11B-v3.0-Instruct.Q6_K.gguf
  • Bielik-PL-11B-v3.0-Instruct.Q5_K_M.gguf
  • Bielik-PL-11B-v3.0-Instruct.Q4_K_M.gguf

Quantization Author

Files quantized by macszym using llama.cpp. Thanks to SpeakLeash for the original model!

Description
Model synced from source: macszym/Bielik-PL-11B-v3.0-Instruct-GGUF
Readme 25 KiB