mradermacher/HamzahLMV0-3B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/HamzahLMV0-3B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-21 23:01:55 +08:00
commit 116f083bb8
27 changed files with 227 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
HamzahLMV0-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
HamzahLMV0-3B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94b1549ef250166fed159cf4fbfc9432fcd4b42d8ff33ced2ac4f475d6222562
size 924188576

3
HamzahLMV0-3B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c5ee030ab7790583869c4627e14babd55c2c85c496d7a72adb3d0f508933b998
size 868155296

3
HamzahLMV0-3B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb91cb7e1fcb5479609b09a5c30d3a12a209bfe26cc0878963c53f685f5822a2
size 1229029280

3
HamzahLMV0-3B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cefd4feb0766ac1672f21212ad8b22da93490ee7e5cd1b2551eb593bec8b3f9a
size 1154318240

3
HamzahLMV0-3B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b2bbf144a673881e9c7add227a97debceef2a12be20385fb58a668c77a416bef
size 1100545952

3
HamzahLMV0-3B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d7cc657d121a48d19f41edea916612e3ae939a23fe34395f82b927665fadcf4
size 1017577376

3
HamzahLMV0-3B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d92557561fca73f5a9b5c0cf1f43e4650658b8ad7c48f0cd40b191c2e5887df
size 1599666080

3
HamzahLMV0-3B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:022ae91cb3681864a792f59caa4b9bd32c5834f57efadd3f9a72d960839331ac
size 1542846368

3
HamzahLMV0-3B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fafa954318e0cae56b21772f8cdec05f0be478f4751569bd81d3320c830f8cea
size 1476786080

3
HamzahLMV0-3B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:100c9f834638e3aacc634fb52463bac4e48b25b3dc9c093c787c638eaa1a1907
size 1348763552

3
HamzahLMV0-3B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6e58b11e336645da483069abec73903484104ce1bba824a3c1e08c8d37323b9f
size 1917188000

3
HamzahLMV0-3B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:078e1064c472489311785621cd88ec4d3e602c527e40fd193d38e56f81832a39
size 1829107616

3
HamzahLMV0-3B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:278f7f25c848e252903b2b41ed80e40109523f0b9ee76946691a8b7aeb9e87b2
size 1363933088

3
HamzahLMV0-3B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e34dc6247d01bf02d061aba913192a5c8e41822b1f07d01bc086d6c1dc5199c
size 1274279840

3
HamzahLMV0-3B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:61d8a667c1f55cc322d5587746f26b9cee3d5219f57f4cd2b244b70aab0b4f4a
size 1815345056

3
HamzahLMV0-3B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:81b40799acb08f565c8cc788b263a09cafcece8f3a00f766b63b91bd08e9edea
size 1687156640

3
HamzahLMV0-3B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:97860ecb97c45dc4c31ade13890ed7ab19e2c4771e3104cfc0308fb1dc8f3aee
size 1542846368

3
HamzahLMV0-3B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0d35e3beedaad2bb91a5cf9eeba5be29f3fce70a6f499f0545d7239c77165621
size 1921906592

3
HamzahLMV0-3B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8c251665e856519fc6a596113dc8213cb0c8bc86f740a078052a7ac5f0d6fbc0
size 2093348768

3
HamzahLMV0-3B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec330b926e47eadf7c610a007b24197f62da5c0b0283b7d4d0a3cc72d7b5f495
size 2019375008

3
HamzahLMV0-3B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ead1f96069b7053ccb9b2d0089b2f02e9491c9ae637b9f4257b2a1beb62c27ed
size 1928198048

3
HamzahLMV0-3B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c41a121671d10cc1c282f3d21d93309455d30705bf7e84a2121ab5d2bd482f2e
size 2322151328

3
HamzahLMV0-3B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cc189e7c3b743e2909f26c875ad1c9c60c29736ce36ccd71d578e2f1374e148d
size 2269509536

3
HamzahLMV0-3B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1caf55e08ef7edb33d5b987e533382def5a9f61d5481e546731913cc4070c83
size 2643851168

92
README.md Normal file
View File

@@ -0,0 +1,92 @@
---
base_model: XeTute/HamzahLMV0-3B
datasets:
- XeTute/Eastern-Alpaca-14k
- XeTute/iloveuser-1k
- open-thoughts/OpenThoughts-114k
language:
- en
- zh
- de
- pt
- it
- fr
- hi
- es
- th
library_name: transformers
license: llama3.2
quantized_by: mradermacher
tags:
- tiny
- rp
- roleplay
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/XeTute/HamzahLMV0-3B
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/HamzahLMV0-3B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 1.0 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.4 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q2_K.gguf) | i1-Q2_K | 1.5 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 1.7 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.8 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.9 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 2.0 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_0.gguf) | i1-Q4_0 | 2.0 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 2.0 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q4_1.gguf) | i1-Q4_1 | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.4 | |
| [GGUF](https://huggingface.co/mradermacher/HamzahLMV0-3B-i1-GGUF/resolve/main/HamzahLMV0-3B.i1-Q6_K.gguf) | i1-Q6_K | 2.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:141e048f7afad9fe6e9559b61531a6a75c7916f293c98617e003ce55d6b90edf
size 2988377