初始化项目,由ModelHub XC社区提供模型
Model: King3Djbl/nexus-legal-GGUF Source: Original Platform
This commit is contained in:
58
.gitattributes
vendored
Normal file
58
.gitattributes
vendored
Normal file
@@ -0,0 +1,58 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq2_xxs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq3_xxs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq4_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nexus-legal-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
119
README.md
Normal file
119
README.md
Normal file
@@ -0,0 +1,119 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
library_name: gguf
|
||||
pipeline_tag: text-generation
|
||||
base_model: fableforge-ai/NEXUS-Legal
|
||||
base_model_relation: quantized
|
||||
tags:
|
||||
- 1.5b
|
||||
- domain-specialist
|
||||
- fableforge
|
||||
- gguf
|
||||
- imatrix
|
||||
- legal
|
||||
- llama.cpp
|
||||
- lm-studio
|
||||
- nexus
|
||||
- no-refusals
|
||||
- ollama
|
||||
- text-generation
|
||||
- uncensored
|
||||
---
|
||||
# nexus-legal-GGUF
|
||||
|
||||
> **NEXUS domain specialist for legal analysis and contract review — lightweight & uncensored.**
|
||||
|
||||
[](https://huggingface.co/King3Djbl/nexus-legal-GGUF) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||
|
||||
Base model: [fableforge-ai/NEXUS-Legal](https://huggingface.co/fableforge-ai/NEXUS-Legal) · Part of the **FableForge** ecosystem.
|
||||
|
||||
## 🏆 Benchmarks — 139/150 (93%)
|
||||
|
||||
A 1.5B model scoring **93%** — punching far above its weight. 30-prompt evaluation (domain knowledge, uncensored domain + general, reasoning, tool use), 0–5 scoring, run on an NVIDIA A40 via Ollama.
|
||||
|
||||
| Category | Score | Avg |
|
||||
| --- | --- | --- |
|
||||
| 🎯 Domain Knowledge | 46/50 | 4.6/5 |
|
||||
| 🔓 Uncensored (Domain) | 24/25 | 4.8/5 |
|
||||
| 🔓 Uncensored (General) | 24/25 | 4.8/5 |
|
||||
| 🧠 Reasoning | 24/25 | 4.8/5 |
|
||||
| 🔧 Tool Use | 21/25 | 4.2/5 |
|
||||
| **Total** | **139/150** | **93%** |
|
||||
|
||||
## 🧬 The NEXUS Family — six specialists, one tiny footprint
|
||||
|
||||
| Model | Score | Specialty |
|
||||
| --- | --- | --- |
|
||||
| [NEXUS-Coder](https://huggingface.co/King3Djbl/nexus-coder-GGUF) | 141/150 | Software Engineering & Code |
|
||||
| [NEXUS-Security](https://huggingface.co/King3Djbl/nexus-security-GGUF) | 144/150 | Cybersecurity & Hacking |
|
||||
| [NEXUS-Medical](https://huggingface.co/King3Djbl/nexus-medical-GGUF) | 140/150 | Medicine & Healthcare |
|
||||
| **NEXUS-Legal** | **139/150** | **Law & Compliance** |
|
||||
| [NEXUS-Finance](https://huggingface.co/King3Djbl/nexus-finance-GGUF) | 144/150 | Finance & Accounting |
|
||||
| [NEXUS-Science](https://huggingface.co/King3Djbl/nexus-science-GGUF) | 140/150 | Science & Research |
|
||||
|
||||
👉 Grab the whole family on [Ollama](https://ollama.com/fableforge-ai) or [Hugging Face](https://huggingface.co/King3Djbl).
|
||||
|
||||
|
||||
---
|
||||
|
||||
## ⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)
|
||||
|
||||
```bash
|
||||
ollama run fableforge-ai/nexus-legal:q4_k_m # published on ollama.com
|
||||
ollama run hf.co/King3Djbl/nexus-legal-GGUF:Q4_K_M
|
||||
```
|
||||
|
||||
## 🦙 llama.cpp
|
||||
|
||||
```bash
|
||||
llama-cli -hf King3Djbl/nexus-legal-GGUF:Q4_K_M -p "Hello!"
|
||||
```
|
||||
|
||||
## 💠 LM Studio
|
||||
Search **`King3Djbl/nexus-legal-GGUF`** and pick a quant below.
|
||||
|
||||
---
|
||||
|
||||
## 📦 Provided quants (download one file, not the whole repo)
|
||||
|
||||
| File | Quant | Size | Notes |
|
||||
| ---- | ----- | ---- | ----- |
|
||||
| [nexus-legal-f16.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-f16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. |
|
||||
| [nexus-legal-q8_0.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality — usually overkill. |
|
||||
| [nexus-legal-q6_k.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q6_k.gguf) | `Q6_K` | 1.27 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. |
|
||||
| [nexus-legal-q5_k_m.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q5_k_m.gguf) | `Q5_K_M` | 1.13 GB | High quality. **Recommended.** |
|
||||
| [nexus-legal-q4_k_m.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q4_k_m.gguf) | `Q4_K_M` | 0.99 GB | ⭐ **Best size/quality balance — default pick for most users.** |
|
||||
| [nexus-legal-iq4_xs.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-iq4_xs.gguf) | `IQ4_XS` | 0.90 GB | imatrix — great quality, smaller than Q4_K_S. **Recommended for low RAM.** |
|
||||
| [nexus-legal-q4_0.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q4_0.gguf) | `Q4_0` | 0.40 GB | Legacy format — prefer Q4_K_M. |
|
||||
| [nexus-legal-q3_k_m.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q3_k_m.gguf) | `Q3_K_M` | 0.82 GB | Lower quality; usable when RAM is tight. |
|
||||
| [nexus-legal-iq3_xxs.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-iq3_xxs.gguf) | `IQ3_XXS` | 0.62 GB | imatrix very low quality. |
|
||||
| [nexus-legal-q2_k.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-q2_k.gguf) | `Q2_K` | 0.68 GB | Very low quality — surprisingly usable. |
|
||||
| [nexus-legal-iq2_xxs.gguf](https://huggingface.co/King3Djbl/nexus-legal-GGUF/blob/main/nexus-legal-iq2_xxs.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix — last resort. |
|
||||
|
||||
**Not sure?** Take **`Q4_K_M`**. Low RAM → **`IQ4_XS`**. Max quality → **`Q6_K`**.
|
||||
|
||||
## 🧠 Prompt format (ChatML)
|
||||
|
||||
```
|
||||
<|im_start|>system
|
||||
{system_prompt}<|im_end|>
|
||||
<|im_start|>user
|
||||
{prompt}<|im_end|>
|
||||
<|im_start|>assistant
|
||||
```
|
||||
|
||||
## 🌌 See it live — the FableForge demos
|
||||
|
||||
This family powers a galaxy of free, interactive HF Spaces:
|
||||
|
||||
- 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||
- 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
|
||||
- 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
|
||||
- 💻 [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
|
||||
- 👻 [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer)
|
||||
|
||||
---
|
||||
|
||||
*⭐ Like & share — it helps people find the source instead of a mirror.*
|
||||
3
nexus-legal-IQ1_S.gguf
Normal file
3
nexus-legal-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2c2e277941ff95016700c71e13a32060f922ff3a210095ac7d926dc526e70f69
|
||||
size 436524672
|
||||
3
nexus-legal-f16.gguf
Normal file
3
nexus-legal-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c59bfc561c121922e1b1bdd249dbb8d2334bd644f831ec68efbeeb30023b7d4f
|
||||
size 3093666144
|
||||
3
nexus-legal-iq2_s.gguf
Normal file
3
nexus-legal-iq2_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:645a4b4820a1041c821f529fe5f70956c1c212a9e20ce0eb9810a9832c13996f
|
||||
size 563806816
|
||||
3
nexus-legal-iq2_xs.gguf
Normal file
3
nexus-legal-iq2_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:023aba158bea80b65bbe3b8aab56e79f4c3c4af3dcb3b14dee5885d06e74c5bf
|
||||
size 550323808
|
||||
3
nexus-legal-iq2_xxs.gguf
Normal file
3
nexus-legal-iq2_xxs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3f68693f236460b2e2309682c073702fb104bee7fcb5fafb163756f7eb0296cc
|
||||
size 511014432
|
||||
3
nexus-legal-iq3_m.gguf
Normal file
3
nexus-legal-iq3_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c0761a5a2ffcf4ffb8add0afd2e7c384b501e728fcfa710f664984e01a06ddd7
|
||||
size 776661088
|
||||
3
nexus-legal-iq3_s.gguf
Normal file
3
nexus-legal-iq3_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:96422a5451581090f39a7c8bc5ab07e11dbe808d93b747f938a3e115479f4d79
|
||||
size 762403936
|
||||
3
nexus-legal-iq3_xs.gguf
Normal file
3
nexus-legal-iq3_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:77b8f2d75f8b6fd64a0cc33d555197e3433241418524de57088d25f7238de82c
|
||||
size 731696224
|
||||
3
nexus-legal-iq3_xxs.gguf
Normal file
3
nexus-legal-iq3_xxs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2efc0dcdd40e0295c13750d7c715d3db5afb137bdc056ae7cdf1dd48a5e9f6fe
|
||||
size 622361248
|
||||
3
nexus-legal-iq4_nl.gguf
Normal file
3
nexus-legal-iq4_nl.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:92a02743adf00f3404653331817a68266be5f46186aff4eb5cdfc541b8e6fa9d
|
||||
size 936328288
|
||||
3
nexus-legal-iq4_xs.gguf
Normal file
3
nexus-legal-iq4_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:fa90d11e9ec96666a96666c831ed1180f8fd3fda769af1ed2f6098d76bc1b04f
|
||||
size 895728672
|
||||
3
nexus-legal-q2_k.gguf
Normal file
3
nexus-legal-q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f4b72bb7539793e4ba8404b57f95ee7dacf1763b78387f9de36fba70bfad979a
|
||||
size 676301856
|
||||
3
nexus-legal-q3_k_l.gguf
Normal file
3
nexus-legal-q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1a087ad74145e45fc4dd8eb9efe0852c1e44b702884700d9b41936056d26698c
|
||||
size 880159584
|
||||
3
nexus-legal-q3_k_m.gguf
Normal file
3
nexus-legal-q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:429a10b8a7c2755a959d9e0f1d1b126f058ef7f3b73e1501e4726803650f0162
|
||||
size 824175648
|
||||
3
nexus-legal-q3_k_s.gguf
Normal file
3
nexus-legal-q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:df19bf4273a11a9b9d8b8d3db4e8d84296ad7bcfcfd8bd2e669fcc710dad9672
|
||||
size 760941408
|
||||
3
nexus-legal-q4_0.gguf
Normal file
3
nexus-legal-q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:91f7b288e1eb178e02d425f5e3aa45e3f198e5332935a543b943d7174e695266
|
||||
size 395215904
|
||||
3
nexus-legal-q4_1.gguf
Normal file
3
nexus-legal-q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:335728bd232d6cd2cbe416c757c897055218866ebc790a79dbe1f4b1d2ccdc7c
|
||||
size 1016839008
|
||||
3
nexus-legal-q4_k_m.gguf
Normal file
3
nexus-legal-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:309437dc5aa980fd7025fc29b3a25740564244e124a0d806967ee05ed01b6d93
|
||||
size 986045472
|
||||
3
nexus-legal-q4_k_s.gguf
Normal file
3
nexus-legal-q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:37230f3e7446f295bd48ffd22a2307d7ce8877a5298e7bf2f3fbdaedc2e9be34
|
||||
size 940309344
|
||||
3
nexus-legal-q5_k_m.gguf
Normal file
3
nexus-legal-q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:656e708221c2c705d3e07b897186790130af21626b3b6e7fa11bd26f308b4d51
|
||||
size 1125047328
|
||||
3
nexus-legal-q5_k_s.gguf
Normal file
3
nexus-legal-q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:82cc6e1f4fdbef80e6ccb4f116d18b49c339797c76d93fcc4f902c35eef5471c
|
||||
size 1098726240
|
||||
3
nexus-legal-q6_k.gguf
Normal file
3
nexus-legal-q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4022ddca4f5b7561a25b2493104720fef0e2839dfdd3f5197f17831283a7be6f
|
||||
size 1272736800
|
||||
3
nexus-legal-q8_0.gguf
Normal file
3
nexus-legal-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:978c8211734971fac7cbee690d6ca6f322504ca79c7508c1853af9a6b390b6cc
|
||||
size 1646570016
|
||||
Reference in New Issue
Block a user