mradermacher/0x-lite-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/0x-lite-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-06 23:45:12 +08:00
commit 89597412d2
13 changed files with 145 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

46
.gitattributes vendored Normal file
View File

@@ -0,0 +1,46 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
0x-lite.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
0x-lite.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
0x-lite.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfb2c5f5d76743c1eda38544f50b6f89ef74574b0db6658a0faeef109ebad325
size 8186196384

3
0x-lite.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83d3b1c73569428ffe5f49fda8d5f007dc4ba973cf04f85b264f8a075021fafa
size 5770498464

3
0x-lite.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ab36ba4bd043ae9ebefa6c767f6dbd605ee13962794441affc6c2f588aab6eed
size 7924769184

3
0x-lite.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:29dc69dfbe18aebd3cb976a95875f80d67bab496a93a761a9708fa1476c6928d
size 7339205024

3
0x-lite.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37827898829b78d999906ed5ce6e766bc3322b6078899be1fae9cbbe337fae93
size 6659596704

3
0x-lite.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89de609287cd2afd6b180d48f8972f763fa5b3b0dcee83e27619b36d1bdd8bf4
size 8988111264

3
0x-lite.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a3771af764d97c929b83c7d5358f8ec67d686ce0816d4aa510017b1ab4d93a81
size 8573432224

3
0x-lite.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:059bc0e39c9df3f4398c688ba47d2e9e78ff1144f44225b56aa08efb8154feec
size 10508874144

3
0x-lite.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ea1f620ba1888afc7f895d6f323511600cce54a6714b7bb27e117a952bdaca5d
size 10266554784

3
0x-lite.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fcee35b005ee78bae5725a740c877eeca9e1992eabebd6b8b4962326cb20eb4
size 12124684704

3
0x-lite.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37affa5827e927e9dfd8e38e50362a8f540ce597033e58c7f1fa7704ba5e6c29
size 15701598624

66
README.md Normal file
View File

@@ -0,0 +1,66 @@
---
base_model: ozone-research/0x-lite
datasets:
- lmsys/lmsys-chat-1m
language:
- en
- zh
library_name: transformers
license: apache-2.0
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
static quants of https://huggingface.co/ozone-research/0x-lite
<!-- provided-files -->
weighted/imatrix quants are available at https://huggingface.co/mradermacher/0x-lite-i1-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q2_K.gguf) | Q2_K | 5.9 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q3_K_S.gguf) | Q3_K_S | 6.8 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q3_K_M.gguf) | Q3_K_M | 7.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q3_K_L.gguf) | Q3_K_L | 8.0 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.IQ4_XS.gguf) | IQ4_XS | 8.3 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q4_K_S.gguf) | Q4_K_S | 8.7 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q4_K_M.gguf) | Q4_K_M | 9.1 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q5_K_S.gguf) | Q5_K_S | 10.4 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q5_K_M.gguf) | Q5_K_M | 10.6 | |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q6_K.gguf) | Q6_K | 12.2 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/0x-lite-GGUF/resolve/main/0x-lite.Q8_0.gguf) | Q8_0 | 15.8 | fast, best quality |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->