Gemma-3-4B-GGUF/README.md

base_model, library_name, tags

base_model	library_name	tags
google/gemma-3-4b-it-qat-int4-unquantized huihui-ai/gemma-3-4b-it-abliterated VIDraft/Gemma-3-R1984-4B neo4j/text-to-cypher-Gemma-3-4B-Instruct-2025.04.0 google/medgemma-4b-it google/gemma-3-4b-it-qat-q4_0-unquantized ZySec-AI/gemma-3-4b-document-writer	transformers	mergekit merge

Gemma-3-4B GGUF Quantized Models

Technical Details

• Quantization Tool: llama.cpp
• Version: version: 5862 (704bb7a7)

Model Information

• Base Model: Gunulhona/Gemma-3-4B
• Quantized by: matrixportal

Available Files

🚀 Download	🔢 Type	📝 Description
Download	Q4 0	Standard 4-bit (fast on ARM)
Download	Q4 K M	4-bit balanced (recommended default)
Download	Q5 K M	5-bit best (recommended HQ option)

💡 Q4 K M provides the best balance for most use cases