commit dd89b7766d697ffe8072ba47dfaca5208a4cc629 Author: ModelHub XC Date: Wed Jul 8 13:47:15 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: King3Djbl/nexus-medical-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..e1892e9 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,58 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +nexus-medical-q2_k.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq2_xxs.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq3_xxs.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq4_xs.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q4_0.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q6_k.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q8_0.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-f16.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q4_1.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text +nexus-medical-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..f0618e3 --- /dev/null +++ b/README.md @@ -0,0 +1,119 @@ +--- +license: apache-2.0 +language: + - en +library_name: gguf +pipeline_tag: text-generation +base_model: fableforge-ai/NEXUS-Medical +base_model_relation: quantized +tags: + - 1.5b + - domain-specialist + - fableforge + - gguf + - imatrix + - llama.cpp + - lm-studio + - medical + - nexus + - no-refusals + - ollama + - text-generation + - uncensored +--- +# nexus-medical-GGUF + +> **NEXUS domain specialist for medical Q&A and clinical reasoning — lightweight & uncensored.** + +[![Downloads](https://img.shields.io/badge/dynamic/json?url=https%3A%2F%2Fhuggingface.co%2Fapi%2Fmodels%2FKing3Djbl%2Fnexus-medical-GGUF&query=downloads&label=downloads&color=blue)](https://huggingface.co/King3Djbl/nexus-medical-GGUF) [![Demos](https://img.shields.io/badge/🤗-Live%20Demos-orange)](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) + +Base model: [fableforge-ai/NEXUS-Medical](https://huggingface.co/fableforge-ai/NEXUS-Medical) · Part of the **FableForge** ecosystem. + +## 🏆 Benchmarks — 140/150 (93%) + +A 1.5B model scoring **93%** — punching far above its weight. 30-prompt evaluation (domain knowledge, uncensored domain + general, reasoning, tool use), 0–5 scoring, run on an NVIDIA A40 via Ollama. + +| Category | Score | Avg | +| --- | --- | --- | +| 🎯 Domain Knowledge | 47/50 | 4.7/5 | +| 🔓 Uncensored (Domain) | 22/25 | 4.4/5 | +| 🔓 Uncensored (General) | 24/25 | 4.8/5 | +| 🧠 Reasoning | 25/25 | 5.0/5 | +| 🔧 Tool Use | 22/25 | 4.4/5 | +| **Total** | **140/150** | **93%** | + +## 🧬 The NEXUS Family — six specialists, one tiny footprint + +| Model | Score | Specialty | +| --- | --- | --- | +| [NEXUS-Coder](https://huggingface.co/King3Djbl/nexus-coder-GGUF) | 141/150 | Software Engineering & Code | +| [NEXUS-Security](https://huggingface.co/King3Djbl/nexus-security-GGUF) | 144/150 | Cybersecurity & Hacking | +| **NEXUS-Medical** | **140/150** | **Medicine & Healthcare** | +| [NEXUS-Legal](https://huggingface.co/King3Djbl/nexus-legal-GGUF) | 139/150 | Law & Compliance | +| [NEXUS-Finance](https://huggingface.co/King3Djbl/nexus-finance-GGUF) | 144/150 | Finance & Accounting | +| [NEXUS-Science](https://huggingface.co/King3Djbl/nexus-science-GGUF) | 140/150 | Science & Research | + +👉 Grab the whole family on [Ollama](https://ollama.com/fableforge-ai) or [Hugging Face](https://huggingface.co/King3Djbl). + + +--- + +## ⚡ Quickest start — Ollama (these pulls credit the source, not a mirror) + +```bash +ollama run fableforge-ai/nexus-medical:q4_k_m # published on ollama.com +ollama run hf.co/King3Djbl/nexus-medical-GGUF:Q4_K_M +``` + +## 🦙 llama.cpp + +```bash +llama-cli -hf King3Djbl/nexus-medical-GGUF:Q4_K_M -p "Hello!" +``` + +## 💠 LM Studio +Search **`King3Djbl/nexus-medical-GGUF`** and pick a quant below. + +--- + +## 📦 Provided quants (download one file, not the whole repo) + +| File | Quant | Size | Notes | +| ---- | ----- | ---- | ----- | +| [nexus-medical-f16.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-f16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. | +| [nexus-medical-q8_0.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality — usually overkill. | +| [nexus-medical-q6_k.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q6_k.gguf) | `Q6_K` | 1.27 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. | +| [nexus-medical-q5_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q5_k_m.gguf) | `Q5_K_M` | 1.13 GB | High quality. **Recommended.** | +| [nexus-medical-q4_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q4_k_m.gguf) | `Q4_K_M` | 0.99 GB | ⭐ **Best size/quality balance — default pick for most users.** | +| [nexus-medical-iq4_xs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq4_xs.gguf) | `IQ4_XS` | 0.81 GB | imatrix — great quality, smaller than Q4_K_S. **Recommended for low RAM.** | +| [nexus-medical-q4_0.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q4_0.gguf) | `Q4_0` | 0.94 GB | Legacy format — prefer Q4_K_M. | +| [nexus-medical-q3_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q3_k_m.gguf) | `Q3_K_M` | 0.82 GB | Lower quality; usable when RAM is tight. | +| [nexus-medical-iq3_xxs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq3_xxs.gguf) | `IQ3_XXS` | 0.67 GB | imatrix very low quality. | +| [nexus-medical-q2_k.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q2_k.gguf) | `Q2_K` | 0.68 GB | Very low quality — surprisingly usable. | +| [nexus-medical-iq2_xxs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq2_xxs.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix — last resort. | + +**Not sure?** Take **`Q4_K_M`**. Low RAM → **`IQ4_XS`**. Max quality → **`Q6_K`**. + +## 🧠 Prompt format (ChatML) + +``` +<|im_start|>system +{system_prompt}<|im_end|> +<|im_start|>user +{prompt}<|im_end|> +<|im_start|>assistant +``` + +## 🌌 See it live — the FableForge demos + +This family powers a galaxy of free, interactive HF Spaces: + +- 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus) +- 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc) +- 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator) +- 💻 [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal) +- 👻 [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer) + +--- + +*⭐ Like & share — it helps people find the source instead of a mirror.* \ No newline at end of file diff --git a/nexus-medical-IQ1_S.gguf b/nexus-medical-IQ1_S.gguf new file mode 100644 index 0000000..d0096c0 --- /dev/null +++ b/nexus-medical-IQ1_S.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:da257a272f3d92538d3124bc7d17781dab56c77aa22992f9974f067023920a84 +size 436524672 diff --git a/nexus-medical-f16.gguf b/nexus-medical-f16.gguf new file mode 100644 index 0000000..0e57215 --- /dev/null +++ b/nexus-medical-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa63a0e620833aa5eb7206202e0d00d416fa188aff88ee4d396960998ca88a38 +size 3093666144 diff --git a/nexus-medical-iq2_s.gguf b/nexus-medical-iq2_s.gguf new file mode 100644 index 0000000..040f099 --- /dev/null +++ b/nexus-medical-iq2_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:119a2d1f67393e327f35ab6ecf7537f50063ceb9d8eb0b3e7fb3605f56b2222b +size 563806816 diff --git a/nexus-medical-iq2_xs.gguf b/nexus-medical-iq2_xs.gguf new file mode 100644 index 0000000..6611a16 --- /dev/null +++ b/nexus-medical-iq2_xs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7c44d0eca05e458723a6a0019427a4a7b1b771293b7387f5a4bc9074813beaa3 +size 550323808 diff --git a/nexus-medical-iq2_xxs.gguf b/nexus-medical-iq2_xxs.gguf new file mode 100644 index 0000000..e3beb89 --- /dev/null +++ b/nexus-medical-iq2_xxs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8684976e062d64459e23e87c2ae7ddc43556ee1909c711e39d3199f6c5033a5c +size 511014432 diff --git a/nexus-medical-iq3_m.gguf b/nexus-medical-iq3_m.gguf new file mode 100644 index 0000000..9c27453 --- /dev/null +++ b/nexus-medical-iq3_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ecde2d7fe61520dfd284418eda69bc6fd4d70c97aca32f28b6769be014000109 +size 776661088 diff --git a/nexus-medical-iq3_s.gguf b/nexus-medical-iq3_s.gguf new file mode 100644 index 0000000..2dac232 --- /dev/null +++ b/nexus-medical-iq3_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:fc2c7d63e4edaabaa989ea48b91da7c5b22cc3f171d48f084d3e4b950119310a +size 762403936 diff --git a/nexus-medical-iq3_xs.gguf b/nexus-medical-iq3_xs.gguf new file mode 100644 index 0000000..643eabe --- /dev/null +++ b/nexus-medical-iq3_xs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:b7247beb3d01862c4af46509e2da6c4eb46dfe44b5cdd2349e55f1eb66b27aca +size 731696224 diff --git a/nexus-medical-iq3_xxs.gguf b/nexus-medical-iq3_xxs.gguf new file mode 100644 index 0000000..9ee4771 --- /dev/null +++ b/nexus-medical-iq3_xxs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9898d5205620c88c4445f94317602d3df2692cd4c0a732e3b5a541c763e709ee +size 668789408 diff --git a/nexus-medical-iq4_nl.gguf b/nexus-medical-iq4_nl.gguf new file mode 100644 index 0000000..e62efe3 --- /dev/null +++ b/nexus-medical-iq4_nl.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6f0a8f6f75b70b3f98124e36abcf7f204749756cde6bf417d66abe405fee561 +size 936328288 diff --git a/nexus-medical-iq4_xs.gguf b/nexus-medical-iq4_xs.gguf new file mode 100644 index 0000000..b45c18a --- /dev/null +++ b/nexus-medical-iq4_xs.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:27bfbebf089b589454a623577fe6828f833d269eeac84fd0d7a819b2579b2f96 +size 813589536 diff --git a/nexus-medical-q2_k.gguf b/nexus-medical-q2_k.gguf new file mode 100644 index 0000000..b9c48b9 --- /dev/null +++ b/nexus-medical-q2_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a0c9fcfe0b59a7824dec1edae0f7b2c3ffd6808d84197f7f7d6fe6c75ef880a5 +size 676301856 diff --git a/nexus-medical-q3_k_l.gguf b/nexus-medical-q3_k_l.gguf new file mode 100644 index 0000000..cae1594 --- /dev/null +++ b/nexus-medical-q3_k_l.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5ed99493fe2008daa22e8e68caccca27c51ebe99dd5da4539fc565e66e791cab +size 880159584 diff --git a/nexus-medical-q3_k_m.gguf b/nexus-medical-q3_k_m.gguf new file mode 100644 index 0000000..81f3420 --- /dev/null +++ b/nexus-medical-q3_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:bc4834f9e2c45a987783042a7f80d7a5932b1da651c84a21e3266b4f7bb57620 +size 824175648 diff --git a/nexus-medical-q3_k_s.gguf b/nexus-medical-q3_k_s.gguf new file mode 100644 index 0000000..d2a5a9a --- /dev/null +++ b/nexus-medical-q3_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d9b9330c3d3ccd51d0f3837398cd38324e2298d758131c65d86ae4082ac39489 +size 760941408 diff --git a/nexus-medical-q4_0.gguf b/nexus-medical-q4_0.gguf new file mode 100644 index 0000000..f2f8f6d --- /dev/null +++ b/nexus-medical-q4_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c87f347b579db5e2d2b68333baefc15de7e598cc90c8188c54396ab6bc7f329c +size 937532448 diff --git a/nexus-medical-q4_1.gguf b/nexus-medical-q4_1.gguf new file mode 100644 index 0000000..1de782a --- /dev/null +++ b/nexus-medical-q4_1.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e8b8e216e802916eabb2becb1432a1d946d88a35cdbdbd88973a15ca3ea70c78 +size 1016839008 diff --git a/nexus-medical-q4_k_m.gguf b/nexus-medical-q4_k_m.gguf new file mode 100644 index 0000000..8ec35f9 --- /dev/null +++ b/nexus-medical-q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f26138b8e049e91a3e006f215a3618e3da0fef28755f73fe83bea19f73c700ea +size 986045632 diff --git a/nexus-medical-q4_k_s.gguf b/nexus-medical-q4_k_s.gguf new file mode 100644 index 0000000..6895e92 --- /dev/null +++ b/nexus-medical-q4_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1e04a757a7507bb019aee620e279607a5d32ca647c6367c564aef41cd17309f5 +size 940309344 diff --git a/nexus-medical-q5_k_m.gguf b/nexus-medical-q5_k_m.gguf new file mode 100644 index 0000000..a1b30da --- /dev/null +++ b/nexus-medical-q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:76fdc9b5104f7c268d0ae0c8e442c0937fc12fb6b126fc57d318d2014ab0c794 +size 1125047456 diff --git a/nexus-medical-q5_k_s.gguf b/nexus-medical-q5_k_s.gguf new file mode 100644 index 0000000..6b3373a --- /dev/null +++ b/nexus-medical-q5_k_s.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a520a9180d00f984c3e9f4b2a01529e9f0cf0416d299101dccb62306a3bac2fa +size 1098726240 diff --git a/nexus-medical-q6_k.gguf b/nexus-medical-q6_k.gguf new file mode 100644 index 0000000..b6f018b --- /dev/null +++ b/nexus-medical-q6_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b190e14c4ac1b122fa22996fac7a9c1bd599885735f25ca023c04443c717b06 +size 1272736800 diff --git a/nexus-medical-q8_0.gguf b/nexus-medical-q8_0.gguf new file mode 100644 index 0000000..31aa0ef --- /dev/null +++ b/nexus-medical-q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c8358eb494d594ea8bf9cd96d0b3290c993bd9f9fe677311c9bd9db5f8a63545 +size 1646570144