From 9b960ca1553f937bb005aeebe8fac988587f2fc7 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Tue, 28 Apr 2026 15:15:01 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: ewald1976/Newton-Insights-V1-cannabis-extraction-science-gguf Source: Original Platform --- .gitattributes | 39 ++++++++ ...ts-V1-cannabis-extraction-science-f16.gguf | 3 + ...V1-cannabis-extraction-science-q4_k_m.gguf | 3 + ...V1-cannabis-extraction-science-q5_k_m.gguf | 3 + ...s-V1-cannabis-extraction-science-q6_k.gguf | 3 + README.md | 90 +++++++++++++++++++ 6 files changed, 141 insertions(+) create mode 100644 .gitattributes create mode 100644 Newton-Insights-V1-cannabis-extraction-science-f16.gguf create mode 100644 Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf create mode 100644 Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf create mode 100644 Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..30d9a82 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,39 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text +Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text +Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf filter=lfs diff=lfs merge=lfs -text +Newton-Insights-V1-cannabis-extraction-science-f16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Newton-Insights-V1-cannabis-extraction-science-f16.gguf b/Newton-Insights-V1-cannabis-extraction-science-f16.gguf new file mode 100644 index 0000000..0c873a0 --- /dev/null +++ b/Newton-Insights-V1-cannabis-extraction-science-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a51d33d0764c4ed450b234141bb61b95f2c15f4607208a0b6c03d064b73a5077 +size 16344139040 diff --git a/Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf b/Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf new file mode 100644 index 0000000..026446d --- /dev/null +++ b/Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:53940fdbfbd135da739caecf12157185f49b97566692b5b04247a46877304d1b +size 4942872832 diff --git a/Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf b/Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf new file mode 100644 index 0000000..95b8169 --- /dev/null +++ b/Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:cde6f426be6eab3c97bef663fd1a7206b6cdec5c5f0cfcbc322444da3ba87675 +size 5797462272 diff --git a/Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf b/Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf new file mode 100644 index 0000000..fd84eec --- /dev/null +++ b/Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:80e3ed0877b005971b2f88174ec55a2ec8c5d93024e973430d1e804deb696443 +size 6705463552 diff --git a/README.md b/README.md new file mode 100644 index 0000000..e319dec --- /dev/null +++ b/README.md @@ -0,0 +1,90 @@ +--- +license: apache-2.0 +tags: +- gguf +- llama.cpp +- cannabis +- science +- text-generation +- local-inference +- domain-specific +- chemistry +- biology +- medical +language: +- en +base_model: +- KellanF89/Newton-Insights-V1-cannabis-extraction-science +--- + +## Note on source files + +This GGUF was built from the `granite-science-merged` files included in the original repository. + +# Newton Insights V1 – Cannabis Extraction Science (GGUF) + +## Model Description + +> GGUF quantized version for local inference (llama.cpp, LM Studio CLI) +This is a GGUF quantized version of: +KellanF89/Newton-Insights-V1-cannabis-extraction-science + +The model is a domain-specific language model trained on cannabis science literature, focusing on: +- extraction techniques +- terpene and cannabinoid chemistry +- pharmacology +- cultivation + +This version was converted and quantized for **local inference** using `llama.cpp`-compatible runtimes. + +--- + +## Model Details + +- **Developed by:** Kellan Finney / Eighth Revolution (original model) +- **Model type:** Causal Language Model (fine-tuned) +- **Language:** English +- **License:** Apache 2.0 +- **Finetuned from:** IBM Granite 3.0 8B Instruct + +--- + +## Available Quantizations + +| File | Quant | Size | Notes | +|------|------|------|------| +| Newton-Insights-V1-cannabis-extraction-science-q4_k_m.gguf | Q4_K_M | ~4-5 GB | Good balance, lower VRAM | +| Newton-Insights-V1-cannabis-extraction-science-q5_k_m.gguf | Q5_K_M | ~5-6 GB | Recommended | +| Newton-Insights-V1-cannabis-extraction-science-q6_k.gguf | Q6_K | ~6-7 GB | Higher quality | +| Newton-Insights-V1-cannabis-extraction-science-f16.gguf | F16 | ~16 GB | Full precision | + +## Uses + +### Direct Use + +- Domain-specific Q&A about cannabis science +- Educational and research purposes +- Local inference setups (offline AI, homelab, experimentation) + +### Out-of-Scope Use + +- Medical advice or treatment recommendations +- Legal interpretation +- Safety-critical decisions + +--- + +## Limitations + +- The model may reflect **inconsistencies in cannabis terminology** (e.g., sativa vs. indica classification). +- Not all responses are guaranteed to be scientifically accurate despite domain fine-tuning. +- Performance may vary depending on prompt formatting and frontend compatibility (Granite-based models use non-standard chat templates). + +--- + +## How to Use + +### llama.cpp + +```bash +./main -m ewald1976/Newton-Insights-V1-cannabis-extraction-science-Q5_K_M.gguf -p "Explain terpene preservation in extraction" \ No newline at end of file