From b43887532ab170daa9b2dc9f17764d13bc1bec38 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Wed, 10 Jun 2026 11:26:17 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF Source: Original Platform --- .gitattributes | 40 +++++++++ Qwen3-0.6B-Hindi-v1-F16.gguf | 3 + Qwen3-0.6B-Hindi-v1-Q2_K.gguf | 3 + Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf | 3 + Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf | 3 + Qwen3-0.6B-Hindi-v1-Q8_0.gguf | 3 + README.md | 154 ++++++++++++++++++++++++++++++++ 7 files changed, 209 insertions(+) create mode 100644 .gitattributes create mode 100644 Qwen3-0.6B-Hindi-v1-F16.gguf create mode 100644 Qwen3-0.6B-Hindi-v1-Q2_K.gguf create mode 100644 Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf create mode 100644 Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf create mode 100644 Qwen3-0.6B-Hindi-v1-Q8_0.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..5d06bd9 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,40 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Qwen3-0.6B-Hindi-v1-F16.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-0.6B-Hindi-v1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Qwen3-0.6B-Hindi-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Qwen3-0.6B-Hindi-v1-F16.gguf b/Qwen3-0.6B-Hindi-v1-F16.gguf new file mode 100644 index 0000000..ce991c6 --- /dev/null +++ b/Qwen3-0.6B-Hindi-v1-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1cc19da87e573ac622dc3709a47eb474688ea388f37c55f50be89449be1d58f0 +size 1198182784 diff --git a/Qwen3-0.6B-Hindi-v1-Q2_K.gguf b/Qwen3-0.6B-Hindi-v1-Q2_K.gguf new file mode 100644 index 0000000..7074fb3 --- /dev/null +++ b/Qwen3-0.6B-Hindi-v1-Q2_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c203aae829a144388f73af86efea4de81b8d2ae44c29c43cab582e50da4476e0 +size 296238464 diff --git a/Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf b/Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf new file mode 100644 index 0000000..bb732a9 --- /dev/null +++ b/Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:89baa1cff8020b4a4623a290a7452d3afdb93cb1258de4a95d3a0bdebad2b368 +size 396705152 diff --git a/Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf b/Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf new file mode 100644 index 0000000..bec9f29 --- /dev/null +++ b/Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:206240a63f52181af6c506f2d0843c8b93b3361d0bdafa68306b57932e9c2f80 +size 444415360 diff --git a/Qwen3-0.6B-Hindi-v1-Q8_0.gguf b/Qwen3-0.6B-Hindi-v1-Q8_0.gguf new file mode 100644 index 0000000..f1a2c9c --- /dev/null +++ b/Qwen3-0.6B-Hindi-v1-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9c7c7d1f4fc52e1d1fda0f4f061b56d40d5dde169c32bdce5c3e1d02ae1a5087 +size 639447424 diff --git a/README.md b/README.md new file mode 100644 index 0000000..eef2bad --- /dev/null +++ b/README.md @@ -0,0 +1,154 @@ +--- +language: +- hi +- en +license: apache-2.0 +tags: +- fine-tuned +- gguf +- hindi +- india +- instruction-tuned +- llama.cpp +- ollama +- quantized +- qwen3 +base_model: pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1 +pipeline_tag: text-generation +base_model_relation: quantized +--- +> ⚠️ **Note:** This 0.6B version is undertrained and does not reliably follow Hindi instructions. For a working Hindi model, please use **[Qwen3-4B-Hindi-Instruct-v2](https://huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2)** ([GGUF here](https://huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2-GGUF)). + +--- + + +# Qwen3-0.6B Hindi Instruct v1 — GGUF + +The smallest Hindi-capable instruction model you can run locally — fits in 370MB, runs on any laptop, no GPU needed. + +Fine-tuned from Qwen/Qwen3-0.6B on English to Hindi instruction pairs. +Quantized to GGUF for local inference with llama.cpp, LM Studio, and Ollama. + +--- + +## Quick Start + +Download the model using huggingface-cli: + + huggingface-cli download pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf --local-dir . + +Run with llama.cpp: + + ./llama-cli -m Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf -p "भारत की राजधानी क्या है?" -n 256 + +Or open directly in LM Studio — New Model — Search pankajpandey-dev + +--- + +## Available Versions + +| File | Quantization | Size | RAM Needed | Best For | +|------|-------------|------|-----------|---------| +| Qwen3-0.6B-Hindi-v1-Q2_K.gguf | Q2_K | 0.28 GB | 1 GB | Minimum hardware | +| Qwen3-0.6B-Hindi-v1-Q4_K_M.gguf | Q4_K_M | 0.37 GB | 1.5 GB | Recommended | +| Qwen3-0.6B-Hindi-v1-Q5_K_M.gguf | Q5_K_M | 0.41 GB | 2 GB | Better quality | +| Qwen3-0.6B-Hindi-v1-Q8_0.gguf | Q8_0 | 0.60 GB | 2.5 GB | Highest quality | + +Not sure which to pick? Always start with Q4_K_M — best balance of speed, size, and quality. + +--- + +## Model Details + +| Property | Value | +|----------|-------| +| Base Model | Qwen/Qwen3-0.6B | +| Parameters | 600M | +| Architecture | Qwen2 — fully supported by llama.cpp | +| Fine-tune Method | QLoRA with LoRA r=16 alpha=16 | +| Training Steps | 60 steps | +| Training Data | 2000 English to Hindi instruction pairs | +| Max Context | 2048 tokens | +| Languages | Hindi and English | +| License | Apache 2.0 — commercial use allowed | + +--- + +## Example Prompts + +Hindi Question Answering: + + User: भारत की राजधानी क्या है? + Model: भारत की राजधानी नई दिल्ली है। + +Hindi Instructions: + + User: मुझे चाय बनाने का तरीका बताओ। + Model: चाय बनाने के लिए पहले पानी गरम करें... + +Mixed Language: + + User: Python में for loop कैसे लिखते हैं? + Model: Python में for loop इस तरह लिखते हैं... + +--- + +## Compatibility + +| Tool | Status | +|------|--------| +| llama.cpp | Full support | +| LM Studio | Full support | +| Ollama | Full support | +| Jan | Full support | +| Open WebUI | Full support | + +--- + +## Recommended Settings + + Temperature: 0.7 + Top-P: 0.9 + Top-K: 40 + Repeat Penalty: 1.1 + Context Length: 2048 + +--- + +## Why This Model? + +- Tiny — 370MB, one of the smallest Hindi-capable GGUF models available +- Fast — runs fully on CPU, no GPU required +- Hindi-first — specifically trained for Hindi instruction following +- Open — Apache 2.0, free for personal and commercial use +- Actively maintained — v2 coming soon with more data + +--- + +## Roadmap + +- Done: v1 — Base Hindi fine-tune on Qwen3-0.6B +- Next: v2 — 10x larger dataset, improved Hindi fluency +- Next: v3 — better instruction following +- Next: Qwen3-1.7B-Hindi — bigger model, same niche +- Next: Live demo Space on HuggingFace + +--- + +## Related Repos + +| Repo | Description | +|------|-------------| +| pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1 | Full precision model in safetensors format | +| pankajpandey-dev/Qwen3-0.6B-Hindi-Instruct-v1-GGUF | This repo — GGUF quantized versions | + +--- + +## About the Author + +Made by pankajpandey-dev +Building open-source Hindi AI models for India + +Follow for weekly model updates and new Hindi LLM releases. + +Found this useful? Please like this repo — it helps other Hindi speakers find it.