mradermacher/Indica-1.7B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Indica-1.7B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-14 11:01:26 +08:00
commit 83c0dceda2
27 changed files with 228 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Indica-1.7B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Indica-1.7B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d222f74abca6576dec43655e48106fd2d2f9ed23232e6c99df8103a976dda77b
size 543794528

3
Indica-1.7B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ade68147a59b2535ee6e242236708b0be402c865aa9f6cb151a33e7836968be4
size 515777888

3
Indica-1.7B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d4c4fd11cee9177c79f9041ada67fb81e679a5a3048c46f10cb393903f8459ec
size 695182688

3
Indica-1.7B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3aabfdce50cc71171f00e415dc57cecbf212057b0f5fa8d9fc46951b4bbca9fa
size 657827168

3
Indica-1.7B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bd66b0468329754460eae4295fc74a4761ca309ebb5b03feac456a2ef497ece1
size 631514464

3
Indica-1.7B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edc9d258a992b63c893f02bc0c144c9cd215eef9d5415405183af0ceb46dbc73
size 590488928

3
Indica-1.7B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:689bd7668a215e99dfc5c86b84b7ca17651ad479d983bb6d6a474a0e07d545d5
size 895663456

3
Indica-1.7B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbdb8da81de91601097bcfc43902d0f86e13926ab434166aac1f75f5444ffe22
size 867253600

3
Indica-1.7B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afd90a44bfa2fa4c6759dfcd88b1a3eee74ec09f3e2a2d7d6997d7e7beac2e96
size 834223456

3
Indica-1.7B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1b6082ad22e0701aa359c1053ffda3f98b90163e8fe995c56a4e617f0dd19042
size 754361696

3
Indica-1.7B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:546084812aec37b7b6228953abb32fd37dd70e6240ceff06ef35678bdf065f55
size 1054424416

3
Indica-1.7B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6df29fb33b847f56e24ae8cc52dfa29ec8a524772d4f5349bf0deb4b8501a677
size 1010384224

3
Indica-1.7B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:536cc7a7187680e6fe06e976ab20f18fb15383f4443f89e4fff4c9d4b8ffc171
size 777796960

3
Indica-1.7B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9dc9ece72f10ffd0525323c083d5a507ff5ea6162911835bb9ea238b1f4dabb6
size 732970336

3
Indica-1.7B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:edbc2dde19ef48a5557050e9023e5f158ca57a7464f764fdf2e9603d1ade7938
size 1003502944

3
Indica-1.7B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:32eac2da993eb3aa5ce165db44e634beb876c4098b755e8d5fb7c2164109a6fa
size 939539808

3
Indica-1.7B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f8fad29129a89185bd5736bdea5d34ae51a81141b111d6e6a60fd9e48ce2c23
size 867253600

3
Indica-1.7B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d87ce6401f0a701509756e12e63f2e73f2b97255fea6c205670ba28a65ea88e6
size 1056783712

3
Indica-1.7B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4ba4096e044902b8d6a9f030cf2e1850e99ec40534d768a198120bb206765898
size 1142504800

3
Indica-1.7B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22d2c85f7b83d9ff180be4318c750749a44b3859bed37ed95ce10d4441d02350
size 1107410272

3
Indica-1.7B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:75e88ec8c1062f9ff0811f8a808fda0011d384558552d0532ebec7f99dcb4131
size 1060191584

3
Indica-1.7B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f3515272211d8b91b0114089c11a93a0cdb762083e442198e2d89ed691c57b8d
size 1257880928

3
Indica-1.7B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f75a2ee06ab2a8d01ee20995f7308ffed6b108acd7bdfafa583c19634ab80e65
size 1230585184

3
Indica-1.7B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54c5c44db4015036022a81d5f1819df51e07b41e9ebbe953b91a20472b33319d
size 1417756000

3
Indica-1.7B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab4bef200c1b801427de63e99b5ccdc007078ddda6def737461411e0f750238d
size 2094560

93
README.md Normal file
View File

@@ -0,0 +1,93 @@
---
base_model: prash616/Indica-1.7B
language:
- hi
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- indian-languages
- hinglish
- reasoning
- experimental
- research
- unsloth
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/prash616/Indica-1.7B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Indica-1.7B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Indica-1.7B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.6 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.6 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.7 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ2_M.gguf) | i1-IQ2_M | 0.8 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.8 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.9 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q2_K.gguf) | i1-Q2_K | 0.9 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.0 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.1 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.2 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q4_0.gguf) | i1-Q4_0 | 1.2 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/Indica-1.7B-i1-GGUF/resolve/main/Indica-1.7B.i1-Q6_K.gguf) | i1-Q6_K | 1.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->