mradermacher/LiteGPT-Base-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/LiteGPT-Base-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-15 08:03:12 +08:00
commit cf3d8525ef
14 changed files with 163 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

47
.gitattributes vendored Normal file
View File

@@ -0,0 +1,47 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
LiteGPT-Base.f16.gguf filter=lfs diff=lfs merge=lfs -text

3
LiteGPT-Base.IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1860b2efaf458a06d461fd93a1dd46c76f363968fbc7bf90c6d837b93335a5eb
size 82589888

3
LiteGPT-Base.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c6b74efbc2f5743f97d4f8fb33679d814046acc48e91504f371a5a8c0df6f4f4
size 68563136

3
LiteGPT-Base.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d8fe4f9d15c047a81008e13d30ea94726be58d312b8b482a741c04d4226eaf14
size 85539008

3
LiteGPT-Base.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1668f83e08d6e3d3a46e7ed00b30234f81a493ebaa6148094a9767ef5cac6ec
size 81115328

3
LiteGPT-Base.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8a7cc0dcbfa2250833ff54351995eae12a6646c7bdf071ddb04f940ebc2d1116
size 73595072

3
LiteGPT-Base.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a6d38feff62f28976ef02c77e55164d700404a91b2fb8dacdae3a1f41665cf2f
size 91179200

3
LiteGPT-Base.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:07da7f8d7dd33591465e245f6932b029f864cdfa412a336df0ce2ffe53dd1331
size 85170368

3
LiteGPT-Base.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:38727a8b3520e0c26e2767dfd3a586dbabd4d163d5a564faf055172a2ea3387c
size 100192448

3
LiteGPT-Base.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:35d107013ed227bc1dc7d56df986ed1561f2c54411044ac752587c7bcabc1135
size 95492288

3
LiteGPT-Base.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d06a84df17cef29b2ba610bb8f7225e0343846a1bfa437ed72eaeabde44fc45b
size 106772672

3
LiteGPT-Base.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:03340a3d4df5eb1302d3c1925b0b8e102a65b40caed3562da77666ac0f22771f
size 136699328

3
LiteGPT-Base.f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:557289dd85db9020a772a3a77ab75f2a2a1694d7a9218e2e4868f143d968076e
size 252544448

80
README.md Normal file
View File

@@ -0,0 +1,80 @@
---
base_model: kmkrworks/LiteGPT-Base
datasets:
- HuggingFaceFW/fineweb-edu
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- gpt2
- pytorch
- causal-lm
- text-generation
- fineweb
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: -->
<!-- ### quants: x-f16 Q4_K_S Q2_K Q8_0 Q6_K Q3_K_M Q3_K_S Q3_K_L Q4_K_M Q5_K_S Q5_K_M IQ4_XS -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
static quants of https://huggingface.co/kmkrworks/LiteGPT-Base
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LiteGPT-Base-GGUF).***
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q2_K.gguf) | Q2_K | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q3_K_S.gguf) | Q3_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q3_K_M.gguf) | Q3_K_M | 0.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.IQ4_XS.gguf) | IQ4_XS | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q4_K_S.gguf) | Q4_K_S | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q3_K_L.gguf) | Q3_K_L | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q4_K_M.gguf) | Q4_K_M | 0.2 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q5_K_S.gguf) | Q5_K_S | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q5_K_M.gguf) | Q5_K_M | 0.2 | |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q6_K.gguf) | Q6_K | 0.2 | very good quality |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.Q8_0.gguf) | Q8_0 | 0.2 | fast, best quality |
| [GGUF](https://huggingface.co/mradermacher/LiteGPT-Base-GGUF/resolve/main/LiteGPT-Base.f16.gguf) | f16 | 0.4 | 16 bpw, overkill |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time.
<!-- end -->