mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-27 11:15:16 +08:00
commit 316679193a
27 changed files with 219 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

60
.gitattributes vendored Normal file
View File

@@ -0,0 +1,60 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4fab2988565069cc097f3e64610e37524ff3f87b5e4d2b5553c9b5bd2933cf7e
size 731572640

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:471d736d85b68bc4b0cb0a0d7a7fd18bd93f5921a7ac613a3e775fda65c6a0f4
size 677038496

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:949a5ecf0b15025b487b77476b4d084b36fc669ee62a3be522acb55e3aee95ed
size 981215648

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b5bab3a09d8310810155730a99354ca609fec34e964ce293393196d8913b237
size 908503456

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dffae3da9571cf9d8f11cfd5a59a733277c7203efda8dec61ee2e6241e619802
size 896223648

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dee2001036dc0bf928e98bf10d63576d2a67539ecf28249e0d2d7215af29bcdd
size 822462880

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96c514bd09eb7192a39852e3b3836753933b9be663b72af11b78061f25d20db0
size 1284868512

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:825199cd20b0b1834108533b2149f34cf3349e95246656945ef12dc47302610a
size 1270524320

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:093b7e76b41b294bc504dc5533b06f5059f912f72374fe6b14b64fc6730359f0
size 1221077408

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9ab2f9550ade0974732915e40b859af06d4b9357fff4767e63bf8977c4c7a828
size 1120528800

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2cac0bb3626d31898654ce9ece7827e808fccc4ad0fc145d4e86676421dea3ef
size 1593895328

3
LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20b3c674e9538079662be42e01c78987edc601d95e7831fbb966e2e7dd095e07
size 1517808032

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b1c94f2be1d86f59880490b9d2a504c449bdcb546bbc05b6a851b1b2ee6f34c5
size 1094592928

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7ab719640017b2381594a69a564db06a2b0de3d22de03a88538c140af2cd1a1c
size 1038723488

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3c57d645f5630efe2261674f8dd4ecd3f7a5b371272491c7e56574b2c42d6db5
size 1451649440

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8ad42ff5c251e2c2b53a5c6b04bf5b703f0d1ced6983aafa6cd56ad2ccb7ef56
size 1366845856

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:42d0232757d15ce6f65f441e520e00c9ecb9dcd4c4c69efb7ea012884f721809
size 1270524320

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:934b343232fa0dd5cac4604e65a267e66216993f79720a5f70135d5a7fb45f6d
size 1598024096

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0fc96675565eeef2cd9e6c6fce8d4a5d7b24c462ef48ec0ad65feca0c656c93a
size 1746069920

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b19710b15123a13e95b8ded0c8586a075c7e58d578fc33c935a863c0c27844e1
size 1674455456

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e18b129e8a8409436b01bd7796745aea59524dd059cd8213a7209aa8db19b094
size 1602677152

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7b87486a63a6b1c53a2ed6cb0647561446ec819ced926bcd7cdc2ccf631c3c55
size 1939745184

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fec871ada33d88a43fc4d0ee5e9eb71fb8eb59d2ef944d03e7aba9b6eac4269c
size 1898244512

3
LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10f55452bbc5e8e79efe1d9bc84b5bf424aea8f05a451307a0c73286af31a9e3
size 2221615520

3
LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eec96bb21b7b3c6d020802d2b5377aa36fbd88e10db2d7a7b968621e75108f80
size 2430848

84
README.md Normal file
View File

@@ -0,0 +1,84 @@
---
base_model: Guilherme34/LFM2.5-2.6B-Abliterated-Advanced
language:
- en
library_name: transformers
mradermacher:
readme_rev: 1
quantized_by: mradermacher
---
## About
<!-- ### quantize_version: 2 -->
<!-- ### output_tensor_quantised: 1 -->
<!-- ### convert_type: hf -->
<!-- ### vocab_type: -->
<!-- ### tags: nicoboss -->
<!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
<!-- ### quants_skip: -->
<!-- ### skip_mmproj: -->
weighted/imatrix quants of https://huggingface.co/Guilherme34/LFM2.5-2.6B-Abliterated-Advanced
<!-- provided-files -->
***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF).***
static quants are available at https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-GGUF
## Usage
If you are unsure how to use GGUF files, refer to one of [TheBloke's
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
more details, including on how to concatenate multi-part files.
## Provided Quants
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
| Link | Type | Size/GB | Notes |
|:-----|:-----|--------:|:------|
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_S.gguf) | i1-IQ1_S | 0.8 | for the desperate |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ1_M.gguf) | i1-IQ1_M | 0.8 | mostly desperate |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 0.9 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_S.gguf) | i1-IQ2_S | 1.0 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ2_M.gguf) | i1-IQ2_M | 1.1 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.1 | very low quality |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q2_K.gguf) | i1-Q2_K | 1.2 | IQ3_XXS probably better |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.2 | lower quality |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.3 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_S.gguf) | i1-IQ3_S | 1.4 | beats Q3_K* |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.4 | IQ3_XS probably better |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ3_M.gguf) | i1-IQ3_M | 1.4 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.5 | IQ3_S probably better |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.6 | IQ3_M probably better |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.6 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.7 | prefer IQ4_XS |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_0.gguf) | i1-Q4_0 | 1.7 | fast, low quality |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.7 | optimal size/speed/quality |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_K_M.gguf) | i1-Q4_K_M | 1.8 | fast, recommended |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q4_1.gguf) | i1-Q4_1 | 1.8 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.0 | |
| [GGUF](https://huggingface.co/mradermacher/LFM2.5-2.6B-Abliterated-Advanced-i1-GGUF/resolve/main/LFM2.5-2.6B-Abliterated-Advanced.i1-Q6_K.gguf) | i1-Q6_K | 2.3 | practically like static Q6_K |
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
And here are Artefact2's thoughts on the matter:
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
## FAQ / Model Request
See https://huggingface.co/mradermacher/model_requests for some answers to
questions you might have and/or if you want some other model quantized.
## Thanks
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
me use its servers and providing upgrades to my workstation to enable
this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
<!-- end -->