初始化项目,由ModelHub XC社区提供模型

Model: Euraika/VulnLLM-R-7B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-10-15 01:06:16 +08:00
commit f69240d0d8
4 changed files with 175 additions and 0 deletions

37
.gitattributes vendored Normal file
View File

@@ -0,0 +1,37 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
VulnLLM-R-7B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
VulnLLM-R-7B-f16.gguf filter=lfs diff=lfs merge=lfs -text

132
README.md Normal file
View File

@@ -0,0 +1,132 @@
---
license: apache-2.0
base_model: Virtue-AI-HUB/VulnLLM-R-7B
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- llama.cpp
- ollama
- quantized
- security
- vulnerability-detection
- reasoning
- qwen2
language:
- en
---
# VulnLLM-R-7B — GGUF
GGUF conversions of [**Virtue-AI-HUB/VulnLLM-R-7B**](https://huggingface.co/Virtue-AI-HUB/VulnLLM-R-7B),
a **reasoning** model for software **vulnerability detection**, fine-tuned from
[Qwen/Qwen2.5-7B-Instruct](https://huggingface.co/Qwen/Qwen2.5-7B-Instruct).
Paper: [arXiv:2512.07533](https://arxiv.org/abs/2512.07533).
These files run the model locally with [`llama.cpp`](https://github.com/ggerganov/llama.cpp),
[Ollama](https://ollama.com), [LM Studio](https://lmstudio.ai), and any GGUF runtime.
## Files
| File | Quant | Size | Notes |
|------|-------|------|-------|
| `VulnLLM-R-7B-f16.gguf` | F16 | ~15 GB | Full-precision GGUF; best quality, largest. |
| `VulnLLM-R-7B-Q8_0.gguf` | Q8_0 | ~8 GB | 8-bit; near-lossless, recommended for most use. |
## Model specs
| Property | Value |
|----------|-------|
| Architecture | `qwen2` (Qwen2.5-7B-Instruct base) |
| Parameters | ~7.6 B |
| **Max context length** | **32,768 tokens (32K)** — native |
| Layers | 28 |
| Embedding dim | 3584 |
| Attention | GQA, 28 Q heads / 4 KV heads |
| Chat template | ChatML (embedded in GGUF metadata) |
**Context notes:** 32K is the native maximum (`max_position_embeddings` / `qwen2.context_length`).
This fine-tune ships **no `rope_scaling`**, so there is no supported YaRN path beyond 32K — pushing
past it degrades quality. Set your runtime window (`num_ctx` / `-c`) as high as 32768; higher windows
cost more KV-cache memory (roughly: 8K ≈ 4 GB, 16K ≈ 7 GB, 32K ≈ 15 GB on top of the ~8 GB Q8_0 weights).
## ⚠️ This is a reasoning model — use the system prompt
VulnLLM-R generates a step-by-step **chain-of-thought** (inside a `</think>`-delimited block)
before its final answer. If you prompt it with a bare question and **no framing**, it can drift
out-of-distribution and produce noisy output. Always give it the analysis framing below — ideally
as the **system** message so it triggers reliably.
**Recommended system prompt:**
```
You are an advanced vulnerability detection model. Analyze the following code
step-by-step to determine whether it contains a security vulnerability. Reason
about data flow, control flow, and security context, then give a final answer
that names the vulnerability, its CWE, and how to fix it. If the code is safe, say so.
```
Then send the code snippet as the user message.
**Suggested sampling:** `temperature 0.3`, `top_p 0.8` (deterministic-leaning analysis).
## Usage
### Ollama
```bash
# Pull directly from this repo (Q8_0):
ollama pull hf.co/Euraika/VulnLLM-R-7B-GGUF:Q8_0
# Recommended: bake in the system prompt, sampling, and full 32K context via a Modelfile:
cat > Modelfile <<'MF'
FROM hf.co/Euraika/VulnLLM-R-7B-GGUF:Q8_0
SYSTEM """You are an advanced vulnerability detection model. Analyze the following code step-by-step to determine whether it contains a security vulnerability. Reason about data flow, control flow, and security context, then give a final answer that names the vulnerability, its CWE, and how to fix it. If the code is safe, say so."""
PARAMETER temperature 0.3
PARAMETER top_p 0.8
PARAMETER num_ctx 32768
MF
ollama create vulnllm-r-7b -f Modelfile
ollama run vulnllm-r-7b "<paste code here>"
```
### llama.cpp
```bash
llama-cli -hf Euraika/VulnLLM-R-7B-GGUF:Q8_0 --temp 0.3 --top-p 0.8 -c 32768 \
-sys "You are an advanced vulnerability detection model. Analyze the code step-by-step, reason about data/control flow and security context, then give a final answer with the vulnerability, its CWE, and a fix." \
-p "<paste code here>"
```
### Chat format (ChatML)
```
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{code}<|im_end|>
<|im_start|>assistant
```
## Conversion
Converted from the original `safetensors` weights to GGUF and quantized to Q8_0.
The F16 GGUF is the intermediate full-precision conversion; Q8_0 is quantized from it.
## License & attribution
Released under **Apache-2.0**, inherited from the base model
[Virtue-AI-HUB/VulnLLM-R-7B](https://huggingface.co/Virtue-AI-HUB/VulnLLM-R-7B)
(derived from Qwen2.5-7B-Instruct, Apache-2.0). All credit for the model belongs to
the original authors; this repository only provides GGUF conversions. Please cite the
[paper](https://arxiv.org/abs/2512.07533) and follow the upstream terms.
```bibtex
@article{nie2025vulnllmr,
title={VulnLLM-R: Specialized Reasoning LLM with Agent Scaffold for Vulnerability Detection},
author={Nie, Yuzhou and Li, Hongwei and Guo, Chengquan and Jiang, Ruizhe and Wang, Zhun and Li, Bo and Song, Dawn and Guo, Wenbo},
journal={arXiv preprint arXiv:2512.07533},
year={2025}
}
```

3
VulnLLM-R-7B-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f01cba28d4741057b6b497744f988bf4fd1b09158e18836d31388387e6c0de44
size 8099131840

3
VulnLLM-R-7B-f16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c2fcdb2a81840be39bf8c2118fe0b45e6c9997069cc488ff84b9f8ca43009fbe
size 15238459840