mradermacher/LLMWriter-3B-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/LLMWriter-3B-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-05 08:41:16 +08:00
commit 01288be85e
27 changed files with 225 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
LLMWriter-3B.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text

3
LLMWriter-3B.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:150c49f07ff4152909110c3e0861ad07ea3d3e4423d4107b5afc7bda7d036b11
size 2161972800

3
LLMWriter-3B.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9804a4f1388c22f2a6aaef37ab1a97727643807071142aa60d3d96ccd4f7c56c
size 2019628608

3
LLMWriter-3B.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3d9fae9308df217ea48613acee4cf2aed20f5f709c1a93cffe41fedc5df7a9c3
size 2948281920

3
LLMWriter-3B.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ce7e38631d434dc2578522ef75dd7746e753ba5366504316f1a8a659dbbe1e2d
size 2758489664

3
LLMWriter-3B.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e4e6b461d1104fd93cfaba296970af8e91167aaf19a50efcd53987a6d03e493d
size 2605782592

3
LLMWriter-3B.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b543cdb545bdc1a8b82b38454e2a780712c4acb6b36d92f8cae81a113c387fd
size 2399213120

3
LLMWriter-3B.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8221af98dbf589fe3347d47e6676a1595fbc3d3e643358aff57737a76707917b
size 3784824384

3
LLMWriter-3B.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b4b5470c9412ec3f20a2c4fa1d7b9d21e8246c08b720b9f8a68c07801636f7fc
size 3682326080

3
LLMWriter-3B.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:878a80ddfbc1378ada59068d4a7ef385a863f8d25bd80f5c5bcd1354baa98ffc
size 3518748224

3
LLMWriter-3B.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5fa7dc8c45670d9d7fbc97a30062dbe59c273cc2c8e908df5119e7ae23bd502e
size 3274913344

3
LLMWriter-3B.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24fa39489281198b91a8e97b478e25d12ddcfe3f377439a3ebc45c5b0e95ac32
size 4677989952

3
LLMWriter-3B.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:66d86b756aa67df9fe7ebd30bbc1db830fedda408e605c363e39b89fe8710c90
size 4447663680

3
LLMWriter-3B.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d56b9b944db9b34ffec6254198b960904d1965d1811e94027b323aad2fd2e562
size 3179132480

3
LLMWriter-3B.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3aaecba73e3c77a311ec0328a23f15e51a1da9d509a1be42517c613cfb31226
size 2988815936

3
LLMWriter-3B.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0810c0685c2523289373b0913e2d5d1161e38144fc69e2dc1977bd5a68da4d57
size 4321957440

3
LLMWriter-3B.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f66191341c0c8f1d7754b8051545978d147841a35a86218b1fc55521cff736d
size 4018918976

3
LLMWriter-3B.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:24a2f43cce15a2d78ad479b150874a41a6d70826edd02b24de49fafb66d069fa
size 3664500288

3
LLMWriter-3B.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d7adc2e66e9f712ea3224f679e3c44906deaeabebcc675c05ac749dbb0a3deb
size 4675892800

3
LLMWriter-3B.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:05434c2c7f600b75ba01bb0d9478e4b88f1179b2a9b2985d6ce010a564c85b53
size 5130253888

3
LLMWriter-3B.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12ac00cd473881b0a98694db09177b367686cc793b45c0554866a3c617605c99
size 4920735296

3
LLMWriter-3B.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3bb7205f4b110962a465c2dd4f16ce856411ff79896ce37cf5d4932e9f3b6082
size 4692670016

3
LLMWriter-3B.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:80a5cf8805476f2f2c2b26b456a3bc176a1295950bd3d3b527a3680de52fe88d
size 5732988480

3
LLMWriter-3B.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0e2eef927b27edc09f2e722a61815777f2c35d9694bd74e8b2edf760814498f3
size 5599295040

3
LLMWriter-3B.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:77fce5371f4445840b8d7f6731830ded66461d17cee887b98d5707c689fab263
size 6596007488

3
LLMWriter-3B.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8513e5a71ea45f943d8e014a260e665b42b551abbff2fee888a755ee297d2c1d
size 5015200

90
README.md Normal file
View File

@@ -0,0 +1,90 @@
---
base_model: aldenirsrv/LLMWriter-3B
language:
- en
library_name: transformers
license: apache-2.0
mradermacher:
readme_rev: 1
quantized_by: mradermacher
tags:
- text-generation-inference
- transformers
- unsloth
- llama
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/aldenirsrv/LLMWriter-3B
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LLMWriter-3B-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/LLMWriter-3B-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/LLMWriter-3B-i1-GGUF/resolve/main/LLMWriter-3B.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->