初始化项目,由ModelHub XC社区提供模型
Model: King3Djbl/nexus-medical-GGUF Source: Original Platform
This commit is contained in:
58
.gitattributes
vendored
Normal file
58
.gitattributes
vendored
Normal file
@@ -0,0 +1,58 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq2_xxs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq3_xxs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq4_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq2_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq2_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq3_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq3_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq3_xs.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-iq4_nl.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q4_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
nexus-medical-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
119
README.md
Normal file
119
README.md
Normal file
@@ -0,0 +1,119 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: gguf
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
base_model: fableforge-ai/NEXUS-Medical
|
||||||
|
base_model_relation: quantized
|
||||||
|
tags:
|
||||||
|
- 1.5b
|
||||||
|
- domain-specialist
|
||||||
|
- fableforge
|
||||||
|
- gguf
|
||||||
|
- imatrix
|
||||||
|
- llama.cpp
|
||||||
|
- lm-studio
|
||||||
|
- medical
|
||||||
|
- nexus
|
||||||
|
- no-refusals
|
||||||
|
- ollama
|
||||||
|
- text-generation
|
||||||
|
- uncensored
|
||||||
|
---
|
||||||
|
# nexus-medical-GGUF
|
||||||
|
|
||||||
|
> **NEXUS domain specialist for medical Q&A and clinical reasoning — lightweight & uncensored.**
|
||||||
|
|
||||||
|
[](https://huggingface.co/King3Djbl/nexus-medical-GGUF) [](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||||
|
|
||||||
|
Base model: [fableforge-ai/NEXUS-Medical](https://huggingface.co/fableforge-ai/NEXUS-Medical) · Part of the **FableForge** ecosystem.
|
||||||
|
|
||||||
|
## 🏆 Benchmarks — 140/150 (93%)
|
||||||
|
|
||||||
|
A 1.5B model scoring **93%** — punching far above its weight. 30-prompt evaluation (domain knowledge, uncensored domain + general, reasoning, tool use), 0–5 scoring, run on an NVIDIA A40 via Ollama.
|
||||||
|
|
||||||
|
| Category | Score | Avg |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| 🎯 Domain Knowledge | 47/50 | 4.7/5 |
|
||||||
|
| 🔓 Uncensored (Domain) | 22/25 | 4.4/5 |
|
||||||
|
| 🔓 Uncensored (General) | 24/25 | 4.8/5 |
|
||||||
|
| 🧠 Reasoning | 25/25 | 5.0/5 |
|
||||||
|
| 🔧 Tool Use | 22/25 | 4.4/5 |
|
||||||
|
| **Total** | **140/150** | **93%** |
|
||||||
|
|
||||||
|
## 🧬 The NEXUS Family — six specialists, one tiny footprint
|
||||||
|
|
||||||
|
| Model | Score | Specialty |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| [NEXUS-Coder](https://huggingface.co/King3Djbl/nexus-coder-GGUF) | 141/150 | Software Engineering & Code |
|
||||||
|
| [NEXUS-Security](https://huggingface.co/King3Djbl/nexus-security-GGUF) | 144/150 | Cybersecurity & Hacking |
|
||||||
|
| **NEXUS-Medical** | **140/150** | **Medicine & Healthcare** |
|
||||||
|
| [NEXUS-Legal](https://huggingface.co/King3Djbl/nexus-legal-GGUF) | 139/150 | Law & Compliance |
|
||||||
|
| [NEXUS-Finance](https://huggingface.co/King3Djbl/nexus-finance-GGUF) | 144/150 | Finance & Accounting |
|
||||||
|
| [NEXUS-Science](https://huggingface.co/King3Djbl/nexus-science-GGUF) | 140/150 | Science & Research |
|
||||||
|
|
||||||
|
👉 Grab the whole family on [Ollama](https://ollama.com/fableforge-ai) or [Hugging Face](https://huggingface.co/King3Djbl).
|
||||||
|
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## ⚡ Quickest start — Ollama (these pulls credit the source, not a mirror)
|
||||||
|
|
||||||
|
```bash
|
||||||
|
ollama run fableforge-ai/nexus-medical:q4_k_m # published on ollama.com
|
||||||
|
ollama run hf.co/King3Djbl/nexus-medical-GGUF:Q4_K_M
|
||||||
|
```
|
||||||
|
|
||||||
|
## 🦙 llama.cpp
|
||||||
|
|
||||||
|
```bash
|
||||||
|
llama-cli -hf King3Djbl/nexus-medical-GGUF:Q4_K_M -p "Hello!"
|
||||||
|
```
|
||||||
|
|
||||||
|
## 💠 LM Studio
|
||||||
|
Search **`King3Djbl/nexus-medical-GGUF`** and pick a quant below.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 📦 Provided quants (download one file, not the whole repo)
|
||||||
|
|
||||||
|
| File | Quant | Size | Notes |
|
||||||
|
| ---- | ----- | ---- | ----- |
|
||||||
|
| [nexus-medical-f16.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-f16.gguf) | `F16` | 3.09 GB | Full precision (unquantized). Reference / conversion. |
|
||||||
|
| [nexus-medical-q8_0.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q8_0.gguf) | `Q8_0` | 1.65 GB | Extremely high quality — usually overkill. |
|
||||||
|
| [nexus-medical-q6_k.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q6_k.gguf) | `Q6_K` | 1.27 GB | Very high quality, near-perfect. **Recommended** if you have the RAM. |
|
||||||
|
| [nexus-medical-q5_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q5_k_m.gguf) | `Q5_K_M` | 1.13 GB | High quality. **Recommended.** |
|
||||||
|
| [nexus-medical-q4_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q4_k_m.gguf) | `Q4_K_M` | 0.99 GB | ⭐ **Best size/quality balance — default pick for most users.** |
|
||||||
|
| [nexus-medical-iq4_xs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq4_xs.gguf) | `IQ4_XS` | 0.81 GB | imatrix — great quality, smaller than Q4_K_S. **Recommended for low RAM.** |
|
||||||
|
| [nexus-medical-q4_0.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q4_0.gguf) | `Q4_0` | 0.94 GB | Legacy format — prefer Q4_K_M. |
|
||||||
|
| [nexus-medical-q3_k_m.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q3_k_m.gguf) | `Q3_K_M` | 0.82 GB | Lower quality; usable when RAM is tight. |
|
||||||
|
| [nexus-medical-iq3_xxs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq3_xxs.gguf) | `IQ3_XXS` | 0.67 GB | imatrix very low quality. |
|
||||||
|
| [nexus-medical-q2_k.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-q2_k.gguf) | `Q2_K` | 0.68 GB | Very low quality — surprisingly usable. |
|
||||||
|
| [nexus-medical-iq2_xxs.gguf](https://huggingface.co/King3Djbl/nexus-medical-GGUF/blob/main/nexus-medical-iq2_xxs.gguf) | `IQ2_XXS` | 0.51 GB | Tiny imatrix — last resort. |
|
||||||
|
|
||||||
|
**Not sure?** Take **`Q4_K_M`**. Low RAM → **`IQ4_XS`**. Max quality → **`Q6_K`**.
|
||||||
|
|
||||||
|
## 🧠 Prompt format (ChatML)
|
||||||
|
|
||||||
|
```
|
||||||
|
<|im_start|>system
|
||||||
|
{system_prompt}<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
{prompt}<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
## 🌌 See it live — the FableForge demos
|
||||||
|
|
||||||
|
This family powers a galaxy of free, interactive HF Spaces:
|
||||||
|
|
||||||
|
- 🧭 [FableForge Nexus](https://huggingface.co/spaces/fableforge-ai/fableforge-nexus)
|
||||||
|
- 🍺 [Infinite NPC](https://huggingface.co/spaces/fableforge-ai/infinite-npc)
|
||||||
|
- 🎭 [Dual-GM](https://huggingface.co/spaces/King3Djbl/dual-gm-simulator)
|
||||||
|
- 💻 [ShellWhisperer](https://huggingface.co/spaces/King3Djbl/shellwhisperer-terminal)
|
||||||
|
- 👻 [Ghost Writer](https://huggingface.co/spaces/fableforge-ai/ghost-writer)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
*⭐ Like & share — it helps people find the source instead of a mirror.*
|
||||||
3
nexus-medical-IQ1_S.gguf
Normal file
3
nexus-medical-IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:da257a272f3d92538d3124bc7d17781dab56c77aa22992f9974f067023920a84
|
||||||
|
size 436524672
|
||||||
3
nexus-medical-f16.gguf
Normal file
3
nexus-medical-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:aa63a0e620833aa5eb7206202e0d00d416fa188aff88ee4d396960998ca88a38
|
||||||
|
size 3093666144
|
||||||
3
nexus-medical-iq2_s.gguf
Normal file
3
nexus-medical-iq2_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:119a2d1f67393e327f35ab6ecf7537f50063ceb9d8eb0b3e7fb3605f56b2222b
|
||||||
|
size 563806816
|
||||||
3
nexus-medical-iq2_xs.gguf
Normal file
3
nexus-medical-iq2_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7c44d0eca05e458723a6a0019427a4a7b1b771293b7387f5a4bc9074813beaa3
|
||||||
|
size 550323808
|
||||||
3
nexus-medical-iq2_xxs.gguf
Normal file
3
nexus-medical-iq2_xxs.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8684976e062d64459e23e87c2ae7ddc43556ee1909c711e39d3199f6c5033a5c
|
||||||
|
size 511014432
|
||||||
3
nexus-medical-iq3_m.gguf
Normal file
3
nexus-medical-iq3_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ecde2d7fe61520dfd284418eda69bc6fd4d70c97aca32f28b6769be014000109
|
||||||
|
size 776661088
|
||||||
3
nexus-medical-iq3_s.gguf
Normal file
3
nexus-medical-iq3_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fc2c7d63e4edaabaa989ea48b91da7c5b22cc3f171d48f084d3e4b950119310a
|
||||||
|
size 762403936
|
||||||
3
nexus-medical-iq3_xs.gguf
Normal file
3
nexus-medical-iq3_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b7247beb3d01862c4af46509e2da6c4eb46dfe44b5cdd2349e55f1eb66b27aca
|
||||||
|
size 731696224
|
||||||
3
nexus-medical-iq3_xxs.gguf
Normal file
3
nexus-medical-iq3_xxs.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9898d5205620c88c4445f94317602d3df2692cd4c0a732e3b5a541c763e709ee
|
||||||
|
size 668789408
|
||||||
3
nexus-medical-iq4_nl.gguf
Normal file
3
nexus-medical-iq4_nl.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e6f0a8f6f75b70b3f98124e36abcf7f204749756cde6bf417d66abe405fee561
|
||||||
|
size 936328288
|
||||||
3
nexus-medical-iq4_xs.gguf
Normal file
3
nexus-medical-iq4_xs.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:27bfbebf089b589454a623577fe6828f833d269eeac84fd0d7a819b2579b2f96
|
||||||
|
size 813589536
|
||||||
3
nexus-medical-q2_k.gguf
Normal file
3
nexus-medical-q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a0c9fcfe0b59a7824dec1edae0f7b2c3ffd6808d84197f7f7d6fe6c75ef880a5
|
||||||
|
size 676301856
|
||||||
3
nexus-medical-q3_k_l.gguf
Normal file
3
nexus-medical-q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5ed99493fe2008daa22e8e68caccca27c51ebe99dd5da4539fc565e66e791cab
|
||||||
|
size 880159584
|
||||||
3
nexus-medical-q3_k_m.gguf
Normal file
3
nexus-medical-q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bc4834f9e2c45a987783042a7f80d7a5932b1da651c84a21e3266b4f7bb57620
|
||||||
|
size 824175648
|
||||||
3
nexus-medical-q3_k_s.gguf
Normal file
3
nexus-medical-q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d9b9330c3d3ccd51d0f3837398cd38324e2298d758131c65d86ae4082ac39489
|
||||||
|
size 760941408
|
||||||
3
nexus-medical-q4_0.gguf
Normal file
3
nexus-medical-q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c87f347b579db5e2d2b68333baefc15de7e598cc90c8188c54396ab6bc7f329c
|
||||||
|
size 937532448
|
||||||
3
nexus-medical-q4_1.gguf
Normal file
3
nexus-medical-q4_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e8b8e216e802916eabb2becb1432a1d946d88a35cdbdbd88973a15ca3ea70c78
|
||||||
|
size 1016839008
|
||||||
3
nexus-medical-q4_k_m.gguf
Normal file
3
nexus-medical-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f26138b8e049e91a3e006f215a3618e3da0fef28755f73fe83bea19f73c700ea
|
||||||
|
size 986045632
|
||||||
3
nexus-medical-q4_k_s.gguf
Normal file
3
nexus-medical-q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1e04a757a7507bb019aee620e279607a5d32ca647c6367c564aef41cd17309f5
|
||||||
|
size 940309344
|
||||||
3
nexus-medical-q5_k_m.gguf
Normal file
3
nexus-medical-q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:76fdc9b5104f7c268d0ae0c8e442c0937fc12fb6b126fc57d318d2014ab0c794
|
||||||
|
size 1125047456
|
||||||
3
nexus-medical-q5_k_s.gguf
Normal file
3
nexus-medical-q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a520a9180d00f984c3e9f4b2a01529e9f0cf0416d299101dccb62306a3bac2fa
|
||||||
|
size 1098726240
|
||||||
3
nexus-medical-q6_k.gguf
Normal file
3
nexus-medical-q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0b190e14c4ac1b122fa22996fac7a9c1bd599885735f25ca023c04443c717b06
|
||||||
|
size 1272736800
|
||||||
3
nexus-medical-q8_0.gguf
Normal file
3
nexus-medical-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c8358eb494d594ea8bf9cd96d0b3290c993bd9f9fe677311c9bd9db5f8a63545
|
||||||
|
size 1646570144
|
||||||
Reference in New Issue
Block a user