mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-11 15:03:47 +08:00
commit 8fce21628d
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Hunyuan-0.5B-Pretrain.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
Hunyuan-0.5B-Pretrain.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:063d88b347a79fd3e211e8041d07008c63f6bcc8d8ac87e12f690e4b4386e641
size 187126784

3
Hunyuan-0.5B-Pretrain.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d031b57d3aac899377b67abea83f81499f4cddec5c7852baf292d441586f7f42
size 179422208

3
Hunyuan-0.5B-Pretrain.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f38498fc4a93c5f37055a4caf975d42ce5a056f1b151ab7f51715cf16a9129b3
size 232838144

3
Hunyuan-0.5B-Pretrain.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:665cf9d837e2130190a670e47847cdee42f1645abc27784d4da5c1559ec9bada
size 222565376

3
Hunyuan-0.5B-Pretrain.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b148d75fa3e0084832f836eb532e53f2b76949375cd6b63661a3e5934c315d56
size 211813376

3
Hunyuan-0.5B-Pretrain.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56ecd2194aa6343dced7859abf15da3757f75187eca1e53b7fc8bc69b9bd821e
size 199967744

3
Hunyuan-0.5B-Pretrain.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ca6ccc622d92cda33915e66054375f24ea0ba66f42ae0456a5134b9a8aba179
size 296713376

3
Hunyuan-0.5B-Pretrain.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:60e37ce9d726676f6053d64a371125af3d4dc0ae9ce411b9c14e98fbb4ef5091
size 285224096

3
Hunyuan-0.5B-Pretrain.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3cfc7778294fdceeb5b5d4c5ee3d97a9c792dcaadb465cf40ddd445b1c5358d0
size 275492000

3
Hunyuan-0.5B-Pretrain.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f66ec14829c3c8936025648460b45b43ec6fd083b28dc665fcb8402823c732aa
size 246969344

3
Hunyuan-0.5B-Pretrain.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb12e5b86f163f12754a7bcb5d70894d351a2d38d62abf384b957d292f8044de
size 340372640

3
Hunyuan-0.5B-Pretrain.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ca18336b805201c7050e968fc5215d450f3b0d0876fa4f171a59980bcb61ff9
size 327396512

3
Hunyuan-0.5B-Pretrain.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:716f9acadd9e203a6267f9cf5e138f1359633aba5d7616cee2d73d0ad2d5062e
size 259665056

3
Hunyuan-0.5B-Pretrain.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8088ba2ee04fc9f0363bfc622f5865327e93b06ed3d90e4c3a27c375a1eae86
size 245632160

3
Hunyuan-0.5B-Pretrain.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7d7040d3cbc324e1c68a571f2a03641a475857a1663fc3b570ed82c675d6894c
size 327396512

3
Hunyuan-0.5B-Pretrain.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9bc7b3cd89c87efe116389abd91a5da14148cf7b44bfa991510fb798cbd7fbd9
size 307670176

3
Hunyuan-0.5B-Pretrain.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5f43a17bc7455a080ae978248123f05024588263530b8fd2d9889186f5e11228
size 285224096

3
Hunyuan-0.5B-Pretrain.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4145041f403c40a171d430da5e44de1f9cd5b23e0f9012caaa70313f1068973
size 341060768

3
Hunyuan-0.5B-Pretrain.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0c020b7fe7d46981c7830c0909388cd0f1817bc0f61d5a1e8d1528c75845025f
size 366324896

3
Hunyuan-0.5B-Pretrain.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8082040a98a6890e654cf7a348f54a22a4971e081f7c559c187b8b1709d3db4c
size 354970784

3
Hunyuan-0.5B-Pretrain.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:467407fcc5e6ede2645d21df51a4cea506501d0a61e61f553f70e571614e5925
size 342273184

3
Hunyuan-0.5B-Pretrain.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e185afbceded7d9e8163d6dd937decc0b788fb7efe191db9957516302271d0f9
size 399797408

3
Hunyuan-0.5B-Pretrain.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b8d6a3707c984809f73d8518148153e3903a617eac4ab66ec356feb6957c6912
size 392277152

3
Hunyuan-0.5B-Pretrain.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c0cce4fa1d40d4b46fb80a3032ef4a9f2c9a6a022138f3b0336550ca01122113
size 447425696

3
Hunyuan-0.5B-Pretrain.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d82db83ee7e892351b7aecdbdaf1c6cc63e02d5803c683b6021bdc6a9e35e2d
size 1058080

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: tencent/Hunyuan-0.5B-Pretrain
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/tencent/Hunyuan-0.5B-Pretrain
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#Hunyuan-0.5B-Pretrain-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ1_S.gguf) | i1-IQ1_S | 0.3 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ1_M.gguf) | i1-IQ1_M | 0.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ2_XS.gguf) | i1-IQ2_XS | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ2_S.gguf) | i1-IQ2_S | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ2_M.gguf) | i1-IQ2_M | 0.3 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q2_K_S.gguf) | i1-Q2_K_S | 0.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 0.3 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q2_K.gguf) | i1-Q2_K | 0.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ3_XS.gguf) | i1-IQ3_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ3_S.gguf) | i1-IQ3_S | 0.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q3_K_S.gguf) | i1-Q3_K_S | 0.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ3_M.gguf) | i1-IQ3_M | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q3_K_M.gguf) | i1-Q3_K_M | 0.4 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ4_XS.gguf) | i1-IQ4_XS | 0.4 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q3_K_L.gguf) | i1-Q3_K_L | 0.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-IQ4_NL.gguf) | i1-IQ4_NL | 0.4 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q4_0.gguf) | i1-Q4_0 | 0.4 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q4_K_S.gguf) | i1-Q4_K_S | 0.4 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q4_K_M.gguf) | i1-Q4_K_M | 0.5 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q4_1.gguf) | i1-Q4_1 | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q5_K_S.gguf) | i1-Q5_K_S | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q5_K_M.gguf) | i1-Q5_K_M | 0.5 | |
| [GGUF](https://huggingface.co/mradermacher/Hunyuan-0.5B-Pretrain-i1-GGUF/resolve/main/Hunyuan-0.5B-Pretrain.i1-Q6_K.gguf) | i1-Q6_K | 0.5 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->