bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-11 16:05:13 +08:00
commit ba1aab6883
30 changed files with 312 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
nbeerbower_Qwen3-Gutenberg-Encore-14B.imatrix filter=lfs diff=lfs merge=lfs -text

181
README.md Normal file
View File

@@ -0,0 +1,181 @@
---
quantized_by: bartowski
pipeline_tag: text-generation
base_model: nbeerbower/Qwen3-Gutenberg-Encore-14B
base_model_relation: quantized
datasets:
- jondurbin/gutenberg-dpo-v0.1
- nbeerbower/gutenberg2-dpo
- nbeerbower/gutenberg-moderne-dpo
- nbeerbower/synthetic-fiction-dpo
- nbeerbower/Arkhaios-DPO
- nbeerbower/Purpura-DPO
- nbeerbower/Schule-DPO
license: apache-2.0
---
## Llamacpp imatrix Quantizations of Qwen3-Gutenberg-Encore-14B by nbeerbower
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b5596">b5596</a> for quantization.
Original model: https://huggingface.co/nbeerbower/Qwen3-Gutenberg-Encore-14B
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
Run them in [LM Studio](https://lmstudio.ai/)
Run them directly with [llama.cpp](https://github.com/ggerganov/llama.cpp), or any other llama.cpp based project
## Prompt format
```
<|im_start|>system
{system_prompt}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
```
## Download a file (not the whole branch) from below:
| Filename | Quant type | File Size | Split | Description |
| -------- | ---------- | --------- | ----- | ----------- |
| [Qwen3-Gutenberg-Encore-14B-bf16.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-bf16.gguf) | bf16 | 29.54GB | false | Full BF16 weights. |
| [Qwen3-Gutenberg-Encore-14B-Q8_0.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q8_0.gguf) | Q8_0 | 15.70GB | false | Extremely high quality, generally unneeded but max available quant. |
| [Qwen3-Gutenberg-Encore-14B-Q6_K_L.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q6_K_L.gguf) | Q6_K_L | 12.50GB | false | Uses Q8_0 for embed and output weights. Very high quality, near perfect, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q6_K.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q6_K.gguf) | Q6_K | 12.12GB | false | Very high quality, near perfect, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q5_K_L.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_L.gguf) | Q5_K_L | 10.99GB | false | Uses Q8_0 for embed and output weights. High quality, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q5_K_M.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_M.gguf) | Q5_K_M | 10.51GB | false | High quality, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q5_K_S.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_S.gguf) | Q5_K_S | 10.26GB | false | High quality, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q4_K_L.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_L.gguf) | Q4_K_L | 9.58GB | false | Uses Q8_0 for embed and output weights. Good quality, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q4_1.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_1.gguf) | Q4_1 | 9.39GB | false | Legacy format, similar performance to Q4_K_S but with improved tokens/watt on Apple silicon. |
| [Qwen3-Gutenberg-Encore-14B-Q4_K_M.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_M.gguf) | Q4_K_M | 9.00GB | false | Good quality, default size for most use cases, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q3_K_XL.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_XL.gguf) | Q3_K_XL | 8.58GB | false | Uses Q8_0 for embed and output weights. Lower quality but usable, good for low RAM availability. |
| [Qwen3-Gutenberg-Encore-14B-Q4_K_S.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_S.gguf) | Q4_K_S | 8.57GB | false | Slightly lower quality with more space savings, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q4_0.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_0.gguf) | Q4_0 | 8.54GB | false | Legacy format, offers online repacking for ARM and AVX CPU inference. |
| [Qwen3-Gutenberg-Encore-14B-IQ4_NL.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ4_NL.gguf) | IQ4_NL | 8.54GB | false | Similar to IQ4_XS, but slightly larger. Offers online repacking for ARM CPU inference. |
| [Qwen3-Gutenberg-Encore-14B-IQ4_XS.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ4_XS.gguf) | IQ4_XS | 8.11GB | false | Decent quality, smaller than Q4_K_S with similar performance, *recommended*. |
| [Qwen3-Gutenberg-Encore-14B-Q3_K_L.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_L.gguf) | Q3_K_L | 7.90GB | false | Lower quality but usable, good for low RAM availability. |
| [Qwen3-Gutenberg-Encore-14B-Q3_K_M.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_M.gguf) | Q3_K_M | 7.32GB | false | Low quality. |
| [Qwen3-Gutenberg-Encore-14B-IQ3_M.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_M.gguf) | IQ3_M | 6.88GB | false | Medium-low quality, new method with decent performance comparable to Q3_K_M. |
| [Qwen3-Gutenberg-Encore-14B-Q3_K_S.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_S.gguf) | Q3_K_S | 6.66GB | false | Low quality, not recommended. |
| [Qwen3-Gutenberg-Encore-14B-Q2_K_L.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q2_K_L.gguf) | Q2_K_L | 6.51GB | false | Uses Q8_0 for embed and output weights. Very low quality but surprisingly usable. |
| [Qwen3-Gutenberg-Encore-14B-IQ3_XS.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_XS.gguf) | IQ3_XS | 6.38GB | false | Lower quality, new method with decent performance, slightly better than Q3_K_S. |
| [Qwen3-Gutenberg-Encore-14B-IQ3_XXS.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_XXS.gguf) | IQ3_XXS | 5.94GB | false | Lower quality, new method with decent performance, comparable to Q3 quants. |
| [Qwen3-Gutenberg-Encore-14B-Q2_K.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-Q2_K.gguf) | Q2_K | 5.75GB | false | Very low quality but surprisingly usable. |
| [Qwen3-Gutenberg-Encore-14B-IQ2_M.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_M.gguf) | IQ2_M | 5.32GB | false | Relatively low quality, uses SOTA techniques to be surprisingly usable. |
| [Qwen3-Gutenberg-Encore-14B-IQ2_S.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_S.gguf) | IQ2_S | 4.96GB | false | Low quality, uses SOTA techniques to be usable. |
| [Qwen3-Gutenberg-Encore-14B-IQ2_XS.gguf](https://huggingface.co/bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF/blob/main/nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_XS.gguf) | IQ2_XS | 4.69GB | false | Low quality, uses SOTA techniques to be usable. |
## Embed/output weights
Some of these quants (Q3_K_XL, Q4_K_L etc) are the standard quantization method with the embeddings and output weights quantized to Q8_0 instead of what they would normally default to.
## Downloading using huggingface-cli
<details>
<summary>Click to view download instructions</summary>
First, make sure you have hugginface-cli installed:
```
pip install -U "huggingface_hub[cli]"
```
Then, you can target the specific file you want:
```
huggingface-cli download bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF --include "nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_M.gguf" --local-dir ./
```
If the model is bigger than 50GB, it will have been split into multiple files. In order to download them all to a local folder, run:
```
huggingface-cli download bartowski/nbeerbower_Qwen3-Gutenberg-Encore-14B-GGUF --include "nbeerbower_Qwen3-Gutenberg-Encore-14B-Q8_0/*" --local-dir ./
```
You can either specify a new local-dir (nbeerbower_Qwen3-Gutenberg-Encore-14B-Q8_0) or download them all in place (./)
</details>
## ARM/AVX information
Previously, you would download Q4_0_4_4/4_8/8_8, and these would have their weights interleaved in memory in order to improve performance on ARM and AVX machines by loading up more data in one pass.
Now, however, there is something called "online repacking" for weights. details in [this PR](https://github.com/ggerganov/llama.cpp/pull/9921). If you use Q4_0 and your hardware would benefit from repacking weights, it will do it automatically on the fly.
As of llama.cpp build [b4282](https://github.com/ggerganov/llama.cpp/releases/tag/b4282) you will not be able to run the Q4_0_X_X files and will instead need to use Q4_0.
Additionally, if you want to get slightly better quality for , you can use IQ4_NL thanks to [this PR](https://github.com/ggerganov/llama.cpp/pull/10541) which will also repack the weights for ARM, though only the 4_4 for now. The loading time may be slower but it will result in an overall speed incrase.
<details>
<summary>Click to view Q4_0_X_X information (deprecated</summary>
I'm keeping this section to show the potential theoretical uplift in performance from using the Q4_0 with online repacking.
<details>
<summary>Click to view benchmarks on an AVX2 system (EPYC7702)</summary>
| model | size | params | backend | threads | test | t/s | % (vs Q4_0) |
| ------------------------------ | ---------: | ---------: | ---------- | ------: | ------------: | -------------------: |-------------: |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp512 | 204.03 ± 1.03 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp1024 | 282.92 ± 0.19 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | pp2048 | 259.49 ± 0.44 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg128 | 39.12 ± 0.27 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg256 | 39.31 ± 0.69 | 100% |
| qwen2 3B Q4_0 | 1.70 GiB | 3.09 B | CPU | 64 | tg512 | 40.52 ± 0.03 | 100% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp512 | 301.02 ± 1.74 | 147% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp1024 | 287.23 ± 0.20 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | pp2048 | 262.77 ± 1.81 | 101% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg128 | 18.80 ± 0.99 | 48% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg256 | 24.46 ± 3.04 | 83% |
| qwen2 3B Q4_K_M | 1.79 GiB | 3.09 B | CPU | 64 | tg512 | 36.32 ± 3.59 | 90% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp512 | 271.71 ± 3.53 | 133% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp1024 | 279.86 ± 45.63 | 100% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | pp2048 | 320.77 ± 5.00 | 124% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg128 | 43.51 ± 0.05 | 111% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg256 | 43.35 ± 0.09 | 110% |
| qwen2 3B Q4_0_8_8 | 1.69 GiB | 3.09 B | CPU | 64 | tg512 | 42.60 ± 0.31 | 105% |
Q4_0_8_8 offers a nice bump to prompt processing and a small bump to text generation
</details>
</details>
## Which file should I choose?
<details>
<summary>Click here for details</summary>
A great write up with charts showing various performances is provided by Artefact2 [here](https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9)
The first thing to figure out is how big a model you can run. To do this, you'll need to figure out how much RAM and/or VRAM you have.
If you want your model running as FAST as possible, you'll want to fit the whole thing on your GPU's VRAM. Aim for a quant with a file size 1-2GB smaller than your GPU's total VRAM.
If you want the absolute maximum quality, add both your system RAM and your GPU's VRAM together, then similarly grab a quant with a file size 1-2GB Smaller than that total.
Next, you'll need to decide if you want to use an 'I-quant' or a 'K-quant'.
If you don't want to think too much, grab one of the K-quants. These are in format 'QX_K_X', like Q5_K_M.
If you want to get more into the weeds, you can check out this extremely useful feature chart:
[llama.cpp feature matrix](https://github.com/ggerganov/llama.cpp/wiki/Feature-matrix)
But basically, if you're aiming for below Q4, and you're running cuBLAS (Nvidia) or rocBLAS (AMD), you should look towards the I-quants. These are in format IQX_X, like IQ3_M. These are newer and offer better performance for their size.
These I-quants can also be used on CPU, but will be slower than their K-quant equivalent, so speed vs performance is a tradeoff you'll have to decide.
</details>
## Credits
Thank you kalomaze and Dampf for assistance in creating the imatrix calibration dataset.
Thank you ZeroWw for the inspiration to experiment with embed/output.
Thank you to LM Studio for sponsoring my work.
Want to support my work? Visit my ko-fi page here: https://ko-fi.com/bartowski

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d0a88b0c2d1205ea52d5a8095e354a1e437fcb7fbcf1eacd75a902dcec8261af
size 5322942944

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a7123354d05ea9e1b8abb58d8d6ff414fe5b9a01b61019bd7910ea20dab8f3af
size 4963314144

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:482bef6d6d654a25f566e89f3f9f310f124b31f472da865e050ad984b03ef12d
size 4691590624

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:bae789ae5a72ac3929c7a8f0bf01d1d124e1f48d2b4cffeb0ff213a583cc4d10
size 6883411424

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed1d80a36a7205b793689f581c31324fd645e05bc1d139ecc7a86665e8bef848
size 6375302624

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1467f69e6e78f5725c6e58ee02410025d8f782d38bbfb42455393e4e8d5826d1
size 5942667744

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcde5a3fcb7385cfd1098123062afb5246d414b60fae5f55612e614748052927
size 8541364704

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65569ae165ba12a24bfe43188ba9db5e494625781eeb84e38f9c51a5008a428d
size 8110731744

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:89c09378211494ce34554d11413dc79622bb2b6839b43b04e530c6225a0776c8
size 5753985504

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q2_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a2442e4da982c8274f199d5dfa5c92bc3bdd50b95e44796a2949eaf15339189f
size 6513665504

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b79fe94789a97f5a40b80454c12efc5ea2bbe321b955658626ef3460dc54d88f
size 7900653024

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ed68ce955ec378c408a31380a21ba21cc8f8c956be60aa78ba27048a0fbfaacf
size 7321314784

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fb122c4613d1e114610d84ddbcb4f1d7884d1689a5caf3e87cf9746162be51c2
size 6657107424

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q3_K_XL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d2111d136de5dc9752546be951c3c785b0df91bca8b4edad82044c319d2c2e9e
size 8581326304

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:30cf2f0c4c7dbeb7dcd56ecfdff37970431e765b18c45386d865d82dd5adeee9
size 8543003104

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3b0b09af4513d5181633d0a11ade9f7d661fe287b5cb473375727e4ac3751eaa
size 9389523424

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d26fe7a88483e110b57da3c8f5b98f91d929aad9e6e29fa4f2e284ab1e52b1b4
size 9579111904

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c4c39a42431ceed3ccfab796fcab7385995e00a59a8a724c51769289c49a7b7
size 9001755104

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:468cc90aa412346ccbb3b95d08794c6c326a4e1ef6ad0b9232a13501e24fd828
size 8573477344

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0616eac4942fcbcbc9ed5c8530ad5d436f725842425a67b9e4794b1d43319a68
size 10994689504

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4694700c2b11051c5a307fc94a78d3620fbe94204b050d7184edc94f615adab9
size 10514571744

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:184b1e1201313dc058937836e12c3d4a1c2411e4768ffdea4628bf995937da39
size 10263896544

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7e51b55039abfeddf414f9e78b0551ff85214584da04596a8708537417a2fc6f
size 12121939424

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q6_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfd8ac5f537f0d1ae9423983103a3edbf095dfbbbb3e4759f5836772c29cb81e
size 12498740704

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:789c9255c48625410b1b95c7d323803090df51919388dbeaf120cf87535daa57
size 15698535904

3
nbeerbower_Qwen3-Gutenberg-Encore-14B-bf16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7654b6f39a06e8db33fdcaf1c3cfeebcd68ffe05d029b848a5e0f81f2c179edf
size 29543425184

3
nbeerbower_Qwen3-Gutenberg-Encore-14B.imatrix Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4750851714cde34f77bf6608d722d059c6cfef62ad03b1c8be79eee7c3d5ffcf
size 7709778