license, base_model, library_name, pipeline_tag, tags
license base_model library_name pipeline_tag tags
apache-2.0 gpugobrrr/Qwen3-0.6B-Farsi gguf text-generation
gguf
llama.cpp
qwen3
text-generation
farsi
persian
quantized

Qwen3-0.6B-Farsi GGUF

GGUF quantizations of gpugobrrr/Qwen3-0.6B-Farsi, a finetune of Qwen/Qwen3-0.6B.

Files

  • Qwen3-0.6B-Farsi-BF16.gguf
  • Qwen3-0.6B-Farsi-F16.gguf
  • Qwen3-0.6B-Farsi-Q3_K_S.gguf
  • Qwen3-0.6B-Farsi-Q4_0.gguf
  • Qwen3-0.6B-Farsi-Q4_K_M.gguf
  • Qwen3-0.6B-Farsi-Q6_K.gguf
  • Qwen3-0.6B-Farsi-Q8_0.gguf

Usage

llama-cli -m Qwen3-0.6B-Farsi-Q4_K_M.gguf -p "سلام، خودت را معرفی کن."
Description
Model synced from source: gpugobrrr/Qwen3-0.6B-Farsi-GGUF
Readme 25 KiB