初始化项目,由ModelHub XC社区提供模型
Model: pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2-GGUF Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-4B-Hindi-v2.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-4B-Hindi-v2.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
Qwen3-4B-Hindi-v2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
Qwen3-4B-Hindi-v2.Q4_K_M.gguf
Normal file
3
Qwen3-4B-Hindi-v2.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e4d2d72923996eb651503bced745f75ddeab0a4c2fa6d64f40a73d19f104a5a4
|
||||
size 2497280704
|
||||
3
Qwen3-4B-Hindi-v2.Q5_K_M.gguf
Normal file
3
Qwen3-4B-Hindi-v2.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:748aad6c9dd0519c3083cc02abd294071717db0fb6e1c89cafb038894f3d0814
|
||||
size 2889513664
|
||||
3
Qwen3-4B-Hindi-v2.Q8_0.gguf
Normal file
3
Qwen3-4B-Hindi-v2.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d43ee831c3878a9863375690c1cfd23f4959e3e2291d5d0a3627f7bb98846b59
|
||||
size 4280405184
|
||||
67
README.md
Normal file
67
README.md
Normal file
@@ -0,0 +1,67 @@
|
||||
---
|
||||
base_model: pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2
|
||||
base_model_relation: quantized
|
||||
language:
|
||||
- hi
|
||||
- en
|
||||
license: apache-2.0
|
||||
library_name: gguf
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- qwen3
|
||||
- hindi
|
||||
- indic
|
||||
- india
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- ollama
|
||||
- lm-studio
|
||||
- instruction-tuned
|
||||
---
|
||||
|
||||
# 🇮🇳 Qwen3-4B Hindi Instruct v2 — GGUF
|
||||
|
||||
GGUF quantizations of **[Qwen3-4B-Hindi-Instruct-v2](https://huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2)** — a Hindi instruction-tuned Qwen3-4B model. These run **locally on CPU or GPU** with llama.cpp, Ollama, and LM Studio — no Python or heavy setup needed.
|
||||
|
||||
Part of the **Hindi LLM Series**, focused on bringing Indic-language models to local and edge devices.
|
||||
|
||||
## Available Quants
|
||||
|
||||
| File | Quant | Size | Recommended for |
|
||||
|------|-------|------|-----------------|
|
||||
| `Qwen3-4B-Hindi-v2.Q4_K_M.gguf` | Q4_K_M | 2.5 GB | **Best balance** — start here |
|
||||
| `Qwen3-4B-Hindi-v2.Q5_K_M.gguf` | Q5_K_M | 2.9 GB | Higher quality, slightly larger |
|
||||
| `Qwen3-4B-Hindi-v2.Q8_0.gguf` | Q8_0 | 4.3 GB | Near-lossless, maximum quality |
|
||||
|
||||
If unsure, download **Q4_K_M** — it's the best size-to-quality tradeoff for most machines.
|
||||
|
||||
## How to Run
|
||||
|
||||
### Ollama
|
||||
```bash
|
||||
huggingface-cli download pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2-GGUF Qwen3-4B-Hindi-v2.Q4_K_M.gguf --local-dir .
|
||||
ollama create qwen3-hindi -f Modelfile
|
||||
ollama run qwen3-hindi "भारत के बारे में एक रोचक तथ्य बताओ।"
|
||||
```
|
||||
|
||||
### llama.cpp
|
||||
```bash
|
||||
./llama-cli -m Qwen3-4B-Hindi-v2.Q4_K_M.gguf -p "भारत की राजधानी क्या है?" -cnv
|
||||
```
|
||||
|
||||
### LM Studio
|
||||
Search for this repo in LM Studio, download the Q4_K_M file, and chat directly in the GUI.
|
||||
|
||||
## About the Model
|
||||
|
||||
This is a Hindi instruction fine-tune of Qwen3-4B (LoRA via Unsloth, 10K Hindi instruction pairs), quantized to GGUF for efficient local inference. It handles both Hindi (Devanagari) and English.
|
||||
|
||||
For full model details and the original 16-bit weights, see the **[base model card](https://huggingface.co/pankajpandey-dev/Qwen3-4B-Hindi-Instruct-v2)**.
|
||||
|
||||
## License
|
||||
|
||||
Apache 2.0 — commercial use allowed.
|
||||
|
||||
---
|
||||
|
||||
*Part of the 🇮🇳 Hindi LLM Series by [pankajpandey-dev](https://huggingface.co/pankajpandey-dev).*
|
||||
Reference in New Issue
Block a user