mradermacher/pythia-2.8b-v0-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/pythia-2.8b-v0-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-09 03:10:06 +08:00
commit 5f9c2d536e
27 changed files with 223 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
imatrix.dat filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
pythia-2.8b-v0.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

88
README.md Normal file
View File

@@ -0,0 +1,88 @@
---
base_model: EleutherAI/pythia-2.8b-v0
datasets:
- the_pile
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- pytorch
- causal-lm
- pythia
- pythia_v0
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/EleutherAI/pythia-2.8b-v0
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#pythia-2.8b-v0-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/pythia-2.8b-v0-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ3_S.gguf) | i1-IQ3_S | 1.3 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.3 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ3_M.gguf) | i1-IQ3_M | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.6 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.7 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q4_1.gguf) | i1-Q4_1 | 1.9 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.9 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.2 | |
| [GGUF](https://huggingface.co/mradermacher/pythia-2.8b-v0-i1-GGUF/resolve/main/pythia-2.8b-v0.i1-Q6_K.gguf) | i1-Q6_K | 2.4 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->

3
imatrix.dat Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8bb83d980cf80c0d39bdbc6257f5b618121c462a627616e3d91b8f2a57812a48
size 2298139

3
pythia-2.8b-v0.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69336247b8c28d28926f7c5bae92e09f8a9171a1267f064b4644d8f9795a34aa
size 707025376

3
pythia-2.8b-v0.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a80f978f642b4ee622c22315c40fc111f38583e63ca9f76b2070a311b68029c3
size 655415776

3
pythia-2.8b-v0.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5c7c6f32a85845dc034ab843b8ce73ce83c064339cd6177b2dbf0d24fe02e6c3
size 990440416

3
pythia-2.8b-v0.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5b8e6002bce23277ac23031dedfb7a1e7dc87a67260f2686f7b960c28859bd9d
size 921627616

3
pythia-2.8b-v0.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c6bee38cdeaa9f1732953e12a546b032a594c0866f4a71df64aa2534ef87fd9
size 868407776

3
pythia-2.8b-v0.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce08cc58ad578eb42c90fd5a6d259520a471a7eaacd526b5b071b814044865d2
size 793041376

3
pythia-2.8b-v0.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7721c2c07910c6e1a7cdbe78ff3284516c59517487efd272de893cedcccd054c
size 1373726176

3
pythia-2.8b-v0.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c38c7e7f2fdc79628ec659b07f4db5266e99c576f7f15f580a353ad1ceb6de4d
size 1248388576

3
pythia-2.8b-v0.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:90ec1c8c1c2b2e1613c832e5924630badbf9c1ea6e73a38c1dca88d34662dfe1
size 1218897376

3
pythia-2.8b-v0.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5d756cf5bd6537aad04bee0b6a3ddcb88dc6fdac651648d59320cc6354379cd6
size 1123150816

3
pythia-2.8b-v0.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb2f04cb99398ca81ae4c939e73fac72efe69fe8f1ccea4170fb084970a45c77
size 1599725536

3
pythia-2.8b-v0.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:afbd2e1cdbdd11d48968fb96b64e4be0d8f37d63b56041f717861cbb9129363e
size 1517058016

3
pythia-2.8b-v0.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f643d1b238b4ddf77608f798b9710097b56ccb40b883f5bd525a6e5460231bb1
size 1086215136

3
pythia-2.8b-v0.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d85575b6bacb25350babd1efc72815696ba55458aa9c47dee6b35d67731f85c8
size 1004295136

3
pythia-2.8b-v0.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:100b763197a089f5f50141dd6f1f3f736e00377a8d12058878e23756e2aa76b5
size 1602282976

3
pythia-2.8b-v0.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17883ea6f6c45ecbdaf8fa45d65ab4cc72869bf6385d1e3afb2765687faebd22
size 1477764576

3
pythia-2.8b-v0.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a5a2ae8a2f4df05767d6e9017a4f97fd8299fa071b9d6c28d5ee16422941ce1
size 1248388576

3
pythia-2.8b-v0.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2ded5e8d73b5e9f5118a392ee4791c741275e4cd8d7b947554074f17a59554a9
size 1606279136

3
pythia-2.8b-v0.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0310c86ad6c0856a47c0505a69b10e24ce1ca50e07754e998384dcca379dee0c
size 1765060576

3
pythia-2.8b-v0.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5a621038f550f75460156b2beecd3dded771343967a8985fcd22774fdb8c2b2a
size 1786503136

3
pythia-2.8b-v0.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05347958152b364cdd5d33a578793f559b89452eb55c2f3428b6dff2172a4680
size 1612832736

3
pythia-2.8b-v0.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7fb5c3cc79430c56d971798a18810c4dc52c03074a1cf63a836d8bedf3f3ff9a
size 2069659616

3
pythia-2.8b-v0.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a0cb09a5fed1567af759937514544126d32ed5d9ee8d876d7d39f620d65950ed
size 1930395616

3
pythia-2.8b-v0.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4cb6ab70a0ab2f124f5ddaf454a7c27d21a7ecb75cff26c9c9342392ece4d2f5
size 2281732576