mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-08 20:39:19 +08:00
commit 1604d7fa1e
26 changed files with 210 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

59
.gitattributes vendored Normal file
View File

@@ -0,0 +1,59 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c02d43e68f3cc2464e60137923375c1ab8a1c6bb2129e16b055872d62079b57
size 2162107520

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:01e1d28f9b8aa4b831e277c21611871c7b0a2a24644eab13888fda5c208c3ae9
size 2019763328

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:70047aba121420f0c26338f7de86cb08d93f072d60dc6af696be3a98e4f0cce0
size 2948429952

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9598a3f177584a61f70bdb1d68e758e9e9611760fd7bf4aaa76c6a3654cc1f7e
size 2758637696

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28ab592913740fa8bd3ac37ff2b9ff5fbd7dece3278fe3e1101eb83a629400e2
size 2605917312

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9399c714840d575ff8d816bff042206c64e8c5845501df330bfcb1bc87329b30
size 2399347840

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcf8569d7868fbf3595a029f11c55d8bb14516a672a201ac813547a99483f03d
size 3784989824

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4bde57a5d9fc6a3bae8bfc883ff678935efc9fcdd81fef5186714ed6ac331ff4
size 3682491520

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2261c13d3654e674e23f7f802f20270bf6c0cb7e843836dbbb20c9bd847056c
size 3518913664

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5984d79c0f649c0642fd9f6d105070e5795ad266cd5fea30c55e1f71c50c2405
size 3275061376

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d1da9e330dd8225a7c809bad63e2d049df71a69974d3a2f847b9a136f89ed363
size 4678172800

3
Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dfb3bac5746ce6b1d18653fa636ffa9b82d9f3e8669d8a5c479538c8258a67e6
size 4447842432

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:45746f73519ac8d255afd8cc651080d10fe2163e3603ef8cc8ad4fcbbd741491
size 3179284608

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f4d15e8672af5821b86eb37734dde0bc83140515cdf0916251b12d8fba48336
size 2988968064

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6fe6551efc0974d24fc578ac3081ecba55c5ff5c651f16c6ead3813e71f8d2b7
size 4322122880

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e3045b91b6615757dddefb5567af025617590663d27987e0966de4bb2a368221
size 4019084416

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4a0e19571bb63aafcf9a76d90c28e50f33cdad1a87a8a66cb0ef60a3426cc9bf
size 3664665728

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f2841f3e3938b107ddd84d78ffafa4269710c0541234d57989a2fabc8d89a6ea
size 4676075648

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:84c404f7191d6daa4ed7729d739ab5328972589f2724b4749ae6049401882a3f
size 5130444928

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ad0641e15452393f5ff6619b6667120839223c886065965b1f1543e23919097e
size 4920918144

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8e5291b6b88cbbb3c12e0e08006dbb52600a1fa857d14053e8091d4fe875a028
size 4692852864

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0f08c92382bcd9cedbf9fd8f5c6e483f17adf8055022205e69aed298ab59499d
size 5733187712

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fc16d976166efc43e5d8e95522300f2fa36e8db168722928529e3fc09a4001cf
size 5599494272

3
Llama_3.1_8b_Dolermed_V1.01.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c84f99d5e6741e6446c9269bb326a171f30e907e385c8e967be38d066fa8900b
size 6596224128

79
README.md Normal file
View File

@@ -0,0 +1,79 @@
---
base_model: Nexesenex/Llama_3.1_8b_Dolermed_V1.01
language:
- en
library_name: transformers
license: llama3.1
quantized_by: mradermacher
tags:
- mergekit
- merge
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
weighted/imatrix quants of https://huggingface.co/Nexesenex/Llama_3.1_8b_Dolermed_V1.01
<!-- provided-files -->
static quants are available at https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_S.gguf) | i1-IQ1_S | 2.1 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ1_M.gguf) | i1-IQ1_M | 2.3 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 2.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_XS.gguf) | i1-IQ2_XS | 2.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_S.gguf) | i1-IQ2_S | 2.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ2_M.gguf) | i1-IQ2_M | 3.0 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K_S.gguf) | i1-Q2_K_S | 3.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q2_K.gguf) | i1-Q2_K | 3.3 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 3.4 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_XS.gguf) | i1-IQ3_XS | 3.6 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_S.gguf) | i1-Q3_K_S | 3.8 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_S.gguf) | i1-IQ3_S | 3.8 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ3_M.gguf) | i1-IQ3_M | 3.9 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_M.gguf) | i1-Q3_K_M | 4.1 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q3_K_L.gguf) | i1-Q3_K_L | 4.4 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_XS.gguf) | i1-IQ4_XS | 4.5 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q4_0.gguf) | i1-Q4_0 | 4.8 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-IQ4_NL.gguf) | i1-IQ4_NL | 4.8 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.8 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q4_K_M.gguf) | i1-Q4_K_M | 5.0 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q4_1.gguf) | i1-Q4_1 | 5.2 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.7 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.8 | |
| [GGUF](https://huggingface.co/mradermacher/Llama_3.1_8b_Dolermed_V1.01-i1-GGUF/resolve/main/Llama_3.1_8b_Dolermed_V1.01.i1-Q6_K.gguf) | i1-Q6_K | 6.7 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->