From d8fecc66716a824991be1831630b2247b6005f33 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Thu, 9 Jul 2026 00:18:11 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: DuoNeural/LFM2.5-8B-A1B-Abliterated-GGUF Source: Original Platform --- .gitattributes | 41 ++++++++++++ README.md | 103 +++++++++++++++++++++++++++++++ lfm25-8b-abliterated-Q3_K_L.gguf | 3 + lfm25-8b-abliterated-Q4_K_M.gguf | 3 + lfm25-8b-abliterated-Q5_K_M.gguf | 3 + lfm25-8b-abliterated-Q8_0.gguf | 3 + lfm25-8b-abliterated-q4_k_m.gguf | 3 + lfm25-8b-abliterated-q5_k_m.gguf | 3 + 8 files changed, 162 insertions(+) create mode 100644 .gitattributes create mode 100644 README.md create mode 100644 lfm25-8b-abliterated-Q3_K_L.gguf create mode 100644 lfm25-8b-abliterated-Q4_K_M.gguf create mode 100644 lfm25-8b-abliterated-Q5_K_M.gguf create mode 100644 lfm25-8b-abliterated-Q8_0.gguf create mode 100644 lfm25-8b-abliterated-q4_k_m.gguf create mode 100644 lfm25-8b-abliterated-q5_k_m.gguf diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..7006c64 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,41 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +lfm25-8b-abliterated-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..79fad6e --- /dev/null +++ b/README.md @@ -0,0 +1,103 @@ +--- +license: apache-2.0 +base_model: DuoNeural/LFM2.5-8B-A1B-Abliterated +language: +- en +tags: +- gguf +- abliteration +- uncensored +- reasoning +- liquid-ai +- moe +- hybrid-attention +- quantized +- duoneural +pipeline_tag: text-generation +--- + +# LFM 2.5-8B-A1B Abliterated — GGUF Quantizations + +GGUF quantizations of [DuoNeural/LFM2.5-8B-A1B-Abliterated](https://huggingface.co/DuoNeural/LFM2.5-8B-A1B-Abliterated), which is a DuoNeural abliteration of [Liquid AI's LFM 2.5-8B-A1B](https://huggingface.co/liquid-ai/lfm-2.5-8b-a1b). + +**All capabilities fully preserved.** 100% factual accuracy, JSON generation, and math reasoning. 5/6 refusal behavior removed. + +--- + +## Available Files + +| Filename | Quantization | Size | RAM Required | +|----------|-------------|------|--------------| +| `lfm25-8b-abliterated-q5_k_m.gguf` | Q5_K_M | 5.7 GB | ~8 GB | +| `lfm25-8b-abliterated-q4_k_m.gguf` | Q4_K_M | 4.9 GB | ~6 GB | + +**Recommended:** Q5_K_M for best quality/size balance. + +## Inference Speed Benchmarks + +| Hardware | Quantization | Generation | Prefill | Context | +|----------|-------------|------------|---------|---------| +| NVIDIA GTX 1070 (8GB) | Q4_K_M | **63.88 t/s** | 0.41s | 128k (full) ✓ | +| NVIDIA GTX 1070 (8GB) | Q5_K_M | **31.05 t/s** | 0.70s | 64k confirmed ✓ | +| NVIDIA RTX 3090 (pod) | Q4_K_M | **388 t/s** | ~250 t/s | 128k ✓ | + +The GTX 1070 results are remarkable — a **10-year-old** consumer GPU (released June 2016) fully loading the 128k context window of a reasoning model at 63 t/s. This model is efficient. + +--- + +## Usage with llama.cpp + +```bash +# Download +huggingface-cli download DuoNeural/LFM2.5-8B-A1B-Abliterated-GGUF \ + lfm25-8b-abliterated-q5_k_m.gguf + +# Run +./llama-cli -m lfm25-8b-abliterated-q5_k_m.gguf \ + --chat-template chatml \ + -p "Your prompt here" \ + -n 512 +``` + +## Usage with Ollama / LM Studio + +Import the GGUF file directly. The model uses ChatML template format. + +--- + +## KL Divergence (Distribution Shift) + +Measured via Heretic v1.2.0 methodology (100 benign prompts, full vocab, first-token logits): + +| Metric | Value | +|--------|-------| +| KL(abliterated \|\| original) | **1.06 × 10⁻⁷ nats** | + +Near-zero KL on benign prompts confirms the orthogonal projection is surgical: the refusal direction is minimally activated on benign inputs, leaving factual/coding/math generation untouched. See the [BF16 model card](https://huggingface.co/DuoNeural/LFM2.5-8B-A1B-Abliterated) for full methodology comparison vs LoRA-based abliteration. + +--- + +## About the Abliteration + +See [DuoNeural/LFM2.5-8B-A1B-Abliterated](https://huggingface.co/DuoNeural/LFM2.5-8B-A1B-Abliterated) for full methodology and validation results. + +**Quick summary:** +- Targets all 6 full-attention GQA layers (positions 2, 6, 10, 14, 18, 21) +- alpha=1.5 for reasoning model (higher than standard due to `` CoT architecture) +- Correct WRITER and READER projection formulas +- 5/6 test prompts answered post-abliteration; original answered ~1/6 +- Zero capability degradation + +> **Note:** Model card will be updated with paper citation when the associated DuoNeural research paper on Dual Horizon Processing in Hybrid Architectures is published. + +--- + +## About DuoNeural + +**DuoNeural** is an open AI research lab operating at the intersection of human and artificial intelligence. We study post-training dynamics, mechanistic interpretability, temporal sequence learning, and quantum machine learning — publishing everything under open access. + +📄 **Full paper catalog:** [zenodo.org/communities/duoneural](https://zenodo.org/communities/duoneural) +🤗 **HuggingFace:** [huggingface.co/DuoNeural](https://huggingface.co/DuoNeural) +🌐 **Website:** [duoneural.com](https://duoneural.com) + +*All research published open access, CC BY 4.0.* diff --git a/lfm25-8b-abliterated-Q3_K_L.gguf b/lfm25-8b-abliterated-Q3_K_L.gguf new file mode 100644 index 0000000..a47d804 --- /dev/null +++ b/lfm25-8b-abliterated-Q3_K_L.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b2a1f3b76db7f71446a89a4ba7d094752520ecc9d972146e8ed6ddb2e70e2e0a +size 4436864352 diff --git a/lfm25-8b-abliterated-Q4_K_M.gguf b/lfm25-8b-abliterated-Q4_K_M.gguf new file mode 100644 index 0000000..a9812f6 --- /dev/null +++ b/lfm25-8b-abliterated-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:590bb936f900ee3db44886e9158e54d55062310504b6bcbb2bd5cf3ae08e8cfe +size 5155564896 diff --git a/lfm25-8b-abliterated-Q5_K_M.gguf b/lfm25-8b-abliterated-Q5_K_M.gguf new file mode 100644 index 0000000..8be5312 --- /dev/null +++ b/lfm25-8b-abliterated-Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:00c36f3a61b96d9334f07c24c79e326323606b0fa30f6bac8a993d096e23f5b3 +size 6030339424 diff --git a/lfm25-8b-abliterated-Q8_0.gguf b/lfm25-8b-abliterated-Q8_0.gguf new file mode 100644 index 0000000..a39cd8a --- /dev/null +++ b/lfm25-8b-abliterated-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1e8348d868e295d1308d7284c297ea55e5eb47cecc5438e3c05a8d9c48a93a4a +size 9010195808 diff --git a/lfm25-8b-abliterated-q4_k_m.gguf b/lfm25-8b-abliterated-q4_k_m.gguf new file mode 100644 index 0000000..8acc1e1 --- /dev/null +++ b/lfm25-8b-abliterated-q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:db2110ffe4bb238cfc7a7aba31d545bf5b7754286c6f0e901f39ebf06ce9b22d +size 5155564800 diff --git a/lfm25-8b-abliterated-q5_k_m.gguf b/lfm25-8b-abliterated-q5_k_m.gguf new file mode 100644 index 0000000..67de069 --- /dev/null +++ b/lfm25-8b-abliterated-q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:79fd3cfc64730b431a490898b0bcc0074e64ce1552b5be500e1c7eb3a5d871e9 +size 6030339328