mradermacher/Intellect_V0.3-1.6B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Intellect_V0.3-1.6B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-27 08:26:16 +08:00
commit fc02d89488
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Intellect_V0.3-1.6B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Intellect_V0.3-1.6B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37f5693d3c63472f0f203f01ab048c25195d840a3e47647c674cc5cf61305abd
size 810230368

3
Intellect_V0.3-1.6B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0b4f053e87da56bc979a87befd15603d3f35e7cd98763e5bc66187c242a63757
size 800150368

3
Intellect_V0.3-1.6B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c99216c49f0bd3fc5d3d03567a787691404543bd3c306da6b375e6e922dd43ea
size 860150368

3
Intellect_V0.3-1.6B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:649ea89b65df7444027c6aa789529895f2cea6cd3957da7b570dea849e38bc51
size 846710368

3
Intellect_V0.3-1.6B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4411d8328af0250752fa4d421b9214ace7e912cba1a5c89b9f24fc8eef44eb1e
size 840470368

3
Intellect_V0.3-1.6B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:36542227942cacbba685cd39e7ac7b59e1eba0f4391dd40d16bb8fc6242db654
size 827030368

3
Intellect_V0.3-1.6B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c552b9e122e0b1833edb51d5ddfe824f841cf09588b2204d2fd44c14cc7dc02
size 976790368

3
Intellect_V0.3-1.6B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7968d0d15c883b5cb2935a6cfb21c594a10af922180aae7f0115d903cb1a2543
size 907190368

3
Intellect_V0.3-1.6B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1f0e26e2dfe8eb92a376ec836c11a9946d91a1604b64fbe865ff388d1c56fe64
size 907190368

3
Intellect_V0.3-1.6B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7eeb127f32dd1b9540b062674bd88d41d47c07ab2b60922e263cae860917e756
size 884150368

3
Intellect_V0.3-1.6B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:507ffe098858c32de8132ae6cdb65f8072e8cd4f001b2f5a77ce8eb9136300c8
size 972470368

3
Intellect_V0.3-1.6B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4e0dacdde0b3a6f7843833037fdba0e71aff09600eb59672d6f61a46a1911797
size 957110368

3
Intellect_V0.3-1.6B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b532db7d35a250b88aa45b2b4fdf7aba63336ea7d163efe6acfa7e147f7e3895
size 907190368

3
Intellect_V0.3-1.6B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cf8cafed1c633404cd8e3266d59d5e46fc5e96e2a8b4cbf6e4ce6ad5c20e0c70
size 871670368

3
Intellect_V0.3-1.6B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:23e0842a5f5824d3eea9efb535833b8744ad3176380a539ebc21c9f799e559f4
size 1103030368

3
Intellect_V0.3-1.6B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a55110523322d58f4f86d52a1713d7030b3f610fc982769cb52f460dd05490f
size 1037750368

3
Intellect_V0.3-1.6B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62ec3e4f69b4f4eeba300a436fe0711e8255fc06eed4a40278a9711283e32453
size 907190368

3
Intellect_V0.3-1.6B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fa3a01cfdfac6c7d38cfc48f98f075844973a63cffe47b6e185d8e3f87c928e
size 976310368

3
Intellect_V0.3-1.6B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37194f728c49e74da065d86b4b0c5215c078765479006fdf56c771d09c069262
size 1069656064

3
Intellect_V0.3-1.6B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b7ef030c8bbd3f32bf0862129adf4bbc2c5cc13eb7148899246e60df23656d82
size 1191801760

3
Intellect_V0.3-1.6B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:038db2e90651b566edb5defb0756996b95942e15c4a3a8e795b9d7ca2f62838e
size 1113081760

3
Intellect_V0.3-1.6B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:870c1fb140cc2beb5bc971b3551f08397ec12e3bf4a987e71930d953a6f60809
size 1381147456

3
Intellect_V0.3-1.6B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d36782dc9d024b824ba349b8be30ea5aa1327b45226044edadf6fe601b83bec
size 1233307456

3
Intellect_V0.3-1.6B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9f691f557a3b13ae7fe21412d11609f575107abdb25b3aff46ea6071f79972d
size 1630915968

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: XeTute/Intellect_V0.3-1.6B
datasets:
- XeTute/Pakistan-China-Alpaca
- BelleGroup/school_math_0.25M
- TIGER-Lab/MathInstruct
language:
- en
- zh
- ur
library_name: transformers
license: mit
quantized_by: mradermacher
tags:
- reasoning
- tiny
- small
- chinese
- english
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/XeTute/Intellect_V0.3-1.6B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ1_M.gguf) | i1-IQ1_M | 0.9 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ2_S.gguf) | i1-IQ2_S | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.0 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.0 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.0 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q2_K.gguf) | i1-Q2_K | 1.0 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.0 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.1 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q4_0.gguf) | i1-Q4_0 | 1.1 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q4_1.gguf) | i1-Q4_1 | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.2 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.2 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.3 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/Intellect_V0.3-1.6B-i1-GGUF/resolve/main/Intellect_V0.3-1.6B.i1-Q6_K.gguf) | i1-Q6_K | 1.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd0951d06cd10c32777bdeb05f88f4f170b22f2da17257b0b5809ef7bb5d9d1f
size 2156971