mradermacher/ProgressLM-3B-SFT-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/ProgressLM-3B-SFT-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-05 03:31:15 +08:00
commit ef5020466d
27 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ProgressLM-3B-SFT.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
ProgressLM-3B-SFT.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e936fa4bbf8f15626d0feebbc857d47109a2f97d541046359f781136fd434297
size 850026208

3
ProgressLM-3B-SFT.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a4587c3f4d6f6cebc2a90d6603d013df4398f1e07ee3066bf34b654d218949d9
size 791092960

3
ProgressLM-3B-SFT.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:591993f9b67399ae3c751647da1429c1134e3448f03bde94995f3d27e58f3097
size 1140514528

3
ProgressLM-3B-SFT.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:070bf3062738411ff155a6bb8f51ec6e469765982723c388863646115cfbd502
size 1061936864

3
ProgressLM-3B-SFT.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4f1270b5d3ab7fc69c7cfa9b50890f338540fd91ac32c616756cf61fbad4c00
size 1031544544

3
ProgressLM-3B-SFT.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e2014e0c9c173ce5c3bb2844d41695c727a1e25cfffc2ed459a9d819b9bd0d83
size 948248288

3
ProgressLM-3B-SFT.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6b848e914b52cf93ab3d72780dcbd4569b2ecec07123a50073235e0780049a97
size 1488893664

3
ProgressLM-3B-SFT.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c9b7d23888dd786ec5b49dc8a633f5bc8d3414a86c7d2cdb1d02733330fd5bb5
size 1456862944

3
ProgressLM-3B-SFT.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f66fd81ff6f1f094919448561780987bf73c667eebc1f82ce8d5819bf66f699
size 1391834848

3
ProgressLM-3B-SFT.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8189d8042694c70ee5eb540551363ae5bfecb83b15d2c82ee9837ddfcd59534e
size 1282825952

3
ProgressLM-3B-SFT.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:696a8ba0bcc6334424a496de992576f6d6029bafbb34fdacc452823de6cedf7d
size 1825208032

3
ProgressLM-3B-SFT.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e645b448f37f72fa631fc8724e83f3309e9c4cdbb07d8813e05a5d9b6b968645
size 1739093728

3
ProgressLM-3B-SFT.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3f86815a8413028baa8823898507b2df8090d7d3d0af5bfb474e62ce9da71e7
size 1274754784

3
ProgressLM-3B-SFT.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2d3cfb16929192c28b35d8baf1ba1ec23686cfb63837bc165c787d2d5ce7fed
size 1198126816

3
ProgressLM-3B-SFT.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9fa0ded8a05d30e38afa5d0f54c47117aeea41e70bc510b18e23826d7b03beb7
size 1707390688

3
ProgressLM-3B-SFT.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:da5071edb33cb41d3abed82fd50c11390e6867486055507c3c74a7f52c7c1762
size 1590474464

3
ProgressLM-3B-SFT.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ec1dfe328bf6d398376be814a50e4e8de5058d222597ccc7f162a30644aad882
size 1454356192

3
ProgressLM-3B-SFT.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3489f7b2430325906835e0999298e5275c62c0715594afcd0619ce7ab70e71cc
size 1828484832

3
ProgressLM-3B-SFT.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:68137e6a0e62d1194b8b751259ab20a388be307d50307c148198582367d8c248
size 1996256992

3
ProgressLM-3B-SFT.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:210a8cc17b44fcbeebe01d675572e61eab02b70dd5189553c359a1114e0a0a01
size 1929901792

3
ProgressLM-3B-SFT.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ac11832f39597ebf3dc6aeef9974b85c5666231e0d0fef2d4048ff33bef4acb0
size 1834383072

3
ProgressLM-3B-SFT.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:50dd51dc35afaf3d79ced9a29eaaf557eaffaa7bcd41f517e3478174a86522c9
size 2224813792

3
ProgressLM-3B-SFT.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f76c488487e5d7194bcf0b622c5ebf5ebd5d93dfdc876a52e2e8e3bac0d806b3
size 2169665248

3
ProgressLM-3B-SFT.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bce26757cb05dbbd7c6c0da144c8b0563f00d451b20a8f7d607e71dd6b1e189e
size 2538157792

3
ProgressLM-3B-SFT.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff262c224b7bb9138c06d06bd1c61d92d370ca08cc8d9cf6a89c753ea8f0e0b5
size 3393408

86
README.md Normal file
View File

@@ -0,0 +1,86 @@
---
base_model: Raymond-Qiancx/ProgressLM-3B-SFT
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Raymond-Qiancx/ProgressLM-3B-SFT
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#ProgressLM-3B-SFT-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/ProgressLM-3B-SFT-GGUF
**This is a vision model - mmproj files (if any) will be in the [static repository](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-GGUF).**
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | |
| [GGUF](https://huggingface.co/mradermacher/ProgressLM-3B-SFT-i1-GGUF/resolve/main/ProgressLM-3B-SFT.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->