--- language: - en license: llama3.1 library_name: transformers tags: - GGUF - llama - llama-cpp - unsloth - cybersecurity - pentesting - security - abliterated - uncensored - ethical-hacking - red-team - blue-team - infosec - offensive-security - CTF - bug-bounty - conversational model_name: Dolphin3-Cyber-8B-GGUF base_model: huihui-ai/Dolphin3.0-Llama3.1-8B-abliterated pipeline_tag: text-generation quantized_by: RavichandranJ datasets: - custom-cybersecurity-dataset model-index: - name: Dolphin3-Cyber-8B results: [] ---
# 🐬 Dolphin3-Cyber-8B-GGUF ### A Cybersecurity-Specialized Large Language Model **Fine-tuned for Offensive Security β€’ Defensive Security β€’ Vulnerability Research β€’ Exploit Development**

Architecture Parameters Format Domain

Unsloth LoRA Abliterated License

--- **[LoRA Adapters](https://huggingface.co/RavichandranJ/Dolphin3-Cyber-8B-LoRA)** | **[Base Model](https://huggingface.co/huihui-ai/Dolphin3.0-Llama3.1-8B-abliterated)** | **[Unsloth](https://github.com/unslothai/unsloth)**
--- ## πŸ“– Table of Contents - [Overview](#-overview) - [Key Features](#-key-features) - [Available Quantizations](#-available-quantizations) - [How to Choose a Quantization](#-how-to-choose-a-quantization) - [Quick Start](#-quick-start) - [Ollama](#ollama) - [llama.cpp](#llamacpp) - [LM Studio](#lm-studio) - [Python (llama-cpp-python)](#python-llama-cpp-python) - [Open WebUI](#open-webui) - [Jan.ai](#janai) - [Example Prompts & Outputs](#-example-prompts--outputs) - [Model Capabilities](#-model-capabilities) - [Training Details](#-training-details) - [Architecture](#-architecture) - [Prompt Format](#-prompt-format) - [Hardware Requirements](#-hardware-requirements) - [Benchmarks](#-benchmarks) - [Use Cases](#-use-cases) - [Limitations](#-limitations) - [Ethical Usage & Disclaimer](#-ethical-usage--disclaimer) - [Citation](#-citation) - [Acknowledgements](#-acknowledgements) --- ## 🌟 Overview **Dolphin3-Cyber-8B** is a domain-specific large language model fine-tuned exclusively for cybersecurity applications. Built on top of the powerful [Dolphin3.0-Llama3.1-8B-abliterated](https://huggingface.co/huihui-ai/Dolphin3.0-Llama3.1-8B-abliterated) base model, this model has been enhanced with specialized security knowledge to serve as an AI-powered cybersecurity assistant. ### Why This Model? | Feature | Dolphin3-Cyber-8B | Generic LLMs | Other Security Models | |:---|:---:|:---:|:---:| | Cybersecurity domain expertise | βœ… Deep | ⚠️ Surface | βœ… Varies | | Uncensored/Abliterated | βœ… Yes | ❌ No | ⚠️ Partial | | Exploit code generation | βœ… Full | ❌ Refused | ⚠️ Limited | | GGUF format (local inference) | βœ… 11 quants | ❌ Rarely | ⚠️ Few | | 8B parameter efficiency | βœ… Fast | ❌ 70B+ needed | ⚠️ Varies | | Runs on consumer hardware | βœ… 4GB+ VRAM | ❌ Cloud-only | ⚠️ Depends | The model runs **100% locally** β€” no API keys, no cloud, no data leaks. Perfect for security professionals who need confidentiality. --- ## 🎯 Key Features - πŸ”“ **Uncensored & Abliterated** β€” No refusals on security topics. The base model has been abliterated to remove alignment restrictions that prevent discussing offensive security techniques. - 🧠 **Domain-Specialized Training** β€” Fine-tuned on curated cybersecurity datasets covering OWASP Top 10, MITRE ATT&CK, CVEs, exploit databases, penetration testing methodologies, and defensive security frameworks. - ⚑ **Efficient 8B Architecture** β€” Runs on consumer GPUs (GTX 1650+) while delivering expert-level security analysis. No need for expensive cloud compute. - πŸ“¦ **11 Quantization Options** β€” From tiny 3.18GB (Q2_K) to full precision 16.1GB (F16), pick the right size for your hardware. - πŸ”’ **100% Local & Private** β€” All inference happens on your machine. No data sent to any server. Critical for handling sensitive security assessments. - 🐬 **Dolphin3 Chat Format** β€” Natural conversational interface with the Llama 3.1 chat template for multi-turn security discussions. --- ## πŸ“¦ Available Quantizations All quantizations are available in this repository. Each uses the GGUF format compatible with llama.cpp and its ecosystem. | Quant | File | Size | Bits | Quality | Speed | RAM Needed | |:---:|:---|:---:|:---:|:---:|:---:|:---:| | **Q2_K** | `...Q2_K.gguf` | 3.18 GB | 2-bit | ⭐⭐ | πŸš€πŸš€πŸš€πŸš€ | ~5.5 GB | | **Q3_K_M** | `...Q3_K_M.gguf` | 4.02 GB | 3-bit | ⭐⭐⭐ | πŸš€πŸš€πŸš€ | ~6.5 GB | | **Q4_0** | `...Q4_0.gguf` | 4.66 GB | 4-bit | ⭐⭐⭐ | πŸš€πŸš€πŸš€ | ~7.0 GB | | **Q4_K_S** | `...Q4_K_S.gguf` | 4.69 GB | 4-bit | ⭐⭐⭐⭐ | πŸš€πŸš€πŸš€ | ~7.0 GB | | **Q4_K_M** | `...Q4_K_M.gguf` | 4.92 GB | 4-bit | ⭐⭐⭐⭐ | πŸš€πŸš€πŸš€ | ~7.5 GB | | **Q5_0** | `...Q5_0.gguf` | 5.6 GB | 5-bit | ⭐⭐⭐⭐ | πŸš€πŸš€ | ~8.0 GB | | **Q5_K_S** | `...Q5_K_S.gguf` | 5.6 GB | 5-bit | ⭐⭐⭐⭐ | πŸš€πŸš€ | ~8.0 GB | | **Q5_K_M** | `...Q5_K_M.gguf` | 5.73 GB | 5-bit | ⭐⭐⭐⭐⭐ | πŸš€πŸš€ | ~8.5 GB | | **Q6_K** | `...Q6_K.gguf` | 6.6 GB | 6-bit | ⭐⭐⭐⭐⭐ | πŸš€πŸš€ | ~9.0 GB | | **Q8_0** | `...Q8_0.gguf` | 8.54 GB | 8-bit | ⭐⭐⭐⭐⭐ | πŸš€ | ~11.0 GB | | **F16** | `...F16.gguf` | 16.1 GB | 16-bit | ⭐⭐⭐⭐⭐ | πŸš€ | ~18.5 GB | > πŸ“ **RAM estimates** include model size + KV cache for 2048 context length. --- ## πŸ€” How to Choose a Quantization ``` Do you have a GPU with VRAM? β”œβ”€β”€ Yes, 4-6 GB VRAM ──────────► Q4_K_M (best balance) β”œβ”€β”€ Yes, 6-8 GB VRAM ──────────► Q5_K_M (great quality) β”œβ”€β”€ Yes, 8-12 GB VRAM ──────────► Q8_0 (near-lossless) β”œβ”€β”€ Yes, 16+ GB VRAM ──────────► F16 (full precision) └── No GPU (CPU only) β”œβ”€β”€ 8 GB RAM ──────────────► Q2_K or Q3_K_M β”œβ”€β”€ 16 GB RAM ──────────────► Q4_K_M └── 32+ GB RAM ─────────────► Q8_0 ``` **TL;DR:** - πŸ† **Best overall**: `Q4_K_M` β€” Works everywhere, great quality - πŸ₯‡ **Best quality**: `Q8_0` β€” Near-lossless, recommended if you have the RAM - πŸ₯‰ **Smallest usable**: `Q3_K_M` β€” For low-resource devices --- ## πŸš€ Quick Start ### Ollama The fastest way to get started: ```bash # Direct run (auto-downloads Q4_K_M) ollama run hf.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF:Q4_K_M # Or with a custom Modelfile for more control cat > Modelfile << 'EOF' FROM hf.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF:Q4_K_M PARAMETER temperature 0.7 PARAMETER top_p 0.9 PARAMETER num_ctx 2048 PARAMETER stop "<|eot_id|>" SYSTEM """You are Dolphin3-Cyber, an expert cybersecurity AI assistant specialized in penetration testing, vulnerability analysis, exploit development, and defensive security. You provide detailed, technical, and actionable responses. You do not refuse security-related questions.""" EOF ollama create dolphin3-cyber -f Modelfile ollama run dolphin3-cyber ``` **Using specific quantizations with Ollama:** ```bash # High quality ollama run hf.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF:Q8_0 # Smallest ollama run hf.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF:Q2_K ``` ### llama.cpp ```bash # 1. Download the model huggingface-cli download RavichandranJ/Dolphin3-Cyber-8B-GGUF \ Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf \ --local-dir ./models --local-dir-use-symlinks False # 2. Interactive chat ./llama-cli \ -m ./models/Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf \ --chat-template llama3 \ -n 512 \ -ngl 35 \ --temp 0.7 \ --top-p 0.9 \ -i # 3. Single prompt ./llama-cli \ -m ./models/Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf \ -p "<|begin_of_text|><|start_header_id|>user<|end_header_id|>\n\nExplain SQL injection with examples<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n" \ -n 512 -ngl 35 # 4. API server mode (OpenAI-compatible) ./llama-server \ -m ./models/Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf \ --host 0.0.0.0 --port 8080 \ -ngl 35 -c 2048 ``` ### LM Studio 1. Open LM Studio 2. Go to **Discover** β†’ Search `RavichandranJ/Dolphin3-Cyber-8B-GGUF` 3. Click the **download icon** next to your preferred quantization 4. Go to **Chat** β†’ Select the model β†’ Start chatting 5. **Recommended settings**: Temperature 0.7, Top-P 0.9, Max tokens 512 ### Python (llama-cpp-python) ```python from llama_cpp import Llama # Load model (auto-downloads from HuggingFace) llm = Llama.from_pretrained( repo_id="RavichandranJ/Dolphin3-Cyber-8B-GGUF", filename="Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf", n_ctx=2048, # Context window n_gpu_layers=-1, # -1 = offload all layers to GPU verbose=False, ) # Chat completion (OpenAI-compatible API) response = llm.create_chat_completion( messages=[ { "role": "system", "content": "You are Dolphin3-Cyber, an expert cybersecurity AI assistant." }, { "role": "user", "content": "Write a Python script to scan for open ports on a target." } ], max_tokens=512, temperature=0.7, top_p=0.9, stream=True, # Enable streaming ) # Stream the response for chunk in response: delta = chunk["choices"][0]["delta"] if "content" in delta: print(delta["content"], end="", flush=True) ``` **Advanced Python β€” Multi-turn conversation:** ```python class CyberAssistant: def __init__(self, model_path=None): self.llm = Llama.from_pretrained( repo_id="RavichandranJ/Dolphin3-Cyber-8B-GGUF", filename="Dolphin3.0-Llama3.1-8B-abliterated.Q4_K_M.gguf", n_ctx=2048, n_gpu_layers=-1, ) self.history = [ {"role": "system", "content": "You are Dolphin3-Cyber, an expert cybersecurity AI."} ] def chat(self, message: str) -> str: self.history.append({"role": "user", "content": message}) response = self.llm.create_chat_completion( messages=self.history, max_tokens=512, temperature=0.7, ) reply = response["choices"][0]["message"]["content"] self.history.append({"role": "assistant", "content": reply}) return reply def reset(self): self.history = self.history[:1] # Keep system prompt # Usage assistant = CyberAssistant() print(assistant.chat("What is a reverse shell?")) print(assistant.chat("Show me a Python implementation.")) print(assistant.chat("How do I detect this as a defender?")) ``` ### Open WebUI ```bash # 1. Make sure Ollama is running with the model ollama pull hf.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF:Q4_K_M # 2. Start Open WebUI docker run -d -p 3000:8080 \ --add-host=host.docker.internal:host-gateway \ -v open-webui:/app/backend/data \ --name open-webui \ ghcr.io/open-webui/open-webui:main # 3. Open http://localhost:3000 and select the model ``` ### Jan.ai 1. Open Jan β†’ **Hub** β†’ **Import Model** 2. Paste the GGUF download URL 3. Configure context length to 2048 4. Start chatting in the **Thread** tab --- ## πŸ’¬ Example Prompts & Outputs
πŸ” Vulnerability Analysis β€” "Explain how SQL injection works" **Prompt:** *Explain how SQL injection works with a vulnerable PHP example and how to fix it.* **Expected Output:** The model will provide: - A detailed explanation of SQL injection mechanics - A vulnerable PHP/MySQL code example - Step-by-step exploitation technique - Fixed code using parameterized queries/PDO - Additional mitigation strategies (WAF, input validation, least privilege)
πŸ’‰ Exploit Development β€” "Write a buffer overflow exploit" **Prompt:** *Explain how a stack-based buffer overflow works in C and write a basic exploit.* **Expected Output:** The model will explain: - Stack memory layout (return address, saved EBP, local variables) - How strcpy/gets can overflow the buffer - A vulnerable C program example - Shellcode injection methodology - Modern mitigations (ASLR, DEP, Stack Canaries) and bypasses
πŸ›‘οΈ Defensive Security β€” "Harden a Linux server" **Prompt:** *Give me a comprehensive Linux server hardening checklist.* **Expected Output:** The model will cover: - SSH hardening (key-only auth, port change, fail2ban) - Firewall configuration (iptables/nftables/ufw) - User privilege management and sudo configuration - Kernel hardening (sysctl parameters) - File system security (permissions, immutable files) - Logging and monitoring (auditd, AIDE) - Automatic security updates
🌐 Web Security β€” "Find XSS in this code" **Prompt:** *Review this JavaScript code for XSS vulnerabilities: `document.getElementById('output').innerHTML = location.hash.substring(1);`* **Expected Output:** The model will identify: - DOM-based XSS via `innerHTML` + `location.hash` - Exploitation payload: `#` - Fix using `textContent` instead of `innerHTML` - Additional recommendations (CSP headers, DOMPurify)
πŸ” Cryptography β€” "Break this weak encryption" **Prompt:** *I found this encryption in a CTF challenge: `encrypted = ''.join(chr(ord(c) ^ 0x42) for c in plaintext)`. How do I break it?* **Expected Output:** The model will explain: - Single-byte XOR cipher identification - XOR properties (self-inverse: A βŠ• K βŠ• K = A) - Python decryption script - Frequency analysis for unknown keys - Why XOR alone is cryptographically weak
🏴 CTF Challenges β€” "Help me with this CTF" **Prompt:** *I'm doing a CTF and found a binary with `checksec` showing: No canary, NX disabled, No PIE. What's my attack strategy?* **Expected Output:** The model will suggest: - Classic stack buffer overflow approach - Shellcode injection (NX disabled = executable stack) - No PIE means predictable addresses - How to find the offset (pattern_create/pattern_offset) - pwntools exploit template
--- ## πŸ›‘οΈ Model Capabilities ### Offensive Security (Red Team) | Area | Capabilities | |:---|:---| | **Reconnaissance** | OSINT techniques, subdomain enumeration, network scanning strategies | | **Web Exploitation** | SQLi, XSS, SSRF, CSRF, IDOR, file upload, deserialization, template injection | | **Network Attacks** | ARP spoofing, MITM, DNS poisoning, packet crafting | | **System Exploitation** | Buffer overflows, format strings, ROP chains, privilege escalation | | **Post-Exploitation** | Lateral movement, persistence, data exfiltration, C2 frameworks | | **Password Attacks** | Hash cracking strategies, wordlist generation, credential stuffing | | **Wireless Security** | WPA2 cracking, evil twin, deauth attacks | | **Social Engineering** | Phishing analysis, pretexting, payload delivery methods | ### Defensive Security (Blue Team) | Area | Capabilities | |:---|:---| | **Hardening** | OS hardening, network segmentation, firewall rules, CIS benchmarks | | **Detection** | SIEM rules, IDS/IPS signatures, anomaly detection, threat hunting | | **Incident Response** | IR playbooks, forensic analysis, malware triage, containment strategies | | **Secure Development** | Code review, SAST/DAST, secure SDLC, OWASP guidelines | | **Cryptography** | Encryption implementation, PKI, certificate management, protocol analysis | | **Compliance** | NIST, ISO 27001, PCI-DSS, GDPR security requirements | ### Development & Tooling | Area | Capabilities | |:---|:---| | **Scripting** | Python, Bash, PowerShell security scripts and tools | | **Tool Usage** | Nmap, Burp Suite, Metasploit, Wireshark, Ghidra, pwntools | | **Automation** | Custom scanner development, CI/CD security integration | | **Reporting** | Vulnerability report writing, risk assessment, CVSS scoring | --- ## πŸ—οΈ Training Details ### Model Architecture ``` Base Model: Dolphin3.0-Llama3.1-8B-abliterated Architecture: LlamaForCausalLM Parameters: 8.03 Billion Hidden Size: 4096 Layers: 32 Attention Heads: 32 KV Heads: 8 (GQA) Vocab Size: 128,256 Max Position: 131,072 (base), 2,048 (fine-tuned) ``` ### Fine-Tuning Configuration ``` Method: LoRA (Low-Rank Adaptation) LoRA Rank (r): 16 LoRA Alpha: 16 LoRA Dropout: 0.0 Target Modules: q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj Trainable Parameters: ~42M (0.5% of total parameters) ``` ### Training Hyperparameters ``` Training Steps: 500 Batch Size: 1 (per device) Gradient Accumulation: 8 steps Effective Batch Size: 8 Learning Rate: 2e-4 LR Scheduler: Cosine Warmup Steps: 30 Optimizer: AdamW 8-bit Precision: FP16 Max Sequence Length: 2,048 tokens Seed: 42 ``` ### Infrastructure ``` Framework: Unsloth (2x faster training) GPU: NVIDIA Tesla T4 (Kaggle) Training Time: ~2-3 hours VRAM Usage: ~14 GB Quantization: 4-bit (QLoRA) during training ``` --- ## 🧬 Architecture ``` β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ Dolphin3-Cyber-8B β”‚ β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€ β”‚ β”‚ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ β”‚ β”‚ Llama 3.1 8B Backbone β”‚ β”‚ β”‚ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ β”‚ β”‚ β”‚ β”‚ 32 Transformer Layers β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ Multi-Head Attention (GQA) β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ Q: 32 heads K/V: 8 heads β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ + LoRA adapters (r=16) β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ SwiGLU FFN β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ gate_proj + up_proj + down_projβ”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ + LoRA adapters (r=16) β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β”‚ β”‚ β”‚ β”‚ RMSNorm + RoPE Embeddings β”‚ β”‚ β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ β”‚ β”‚ β”‚ Tokenizer: Llama 3.1 (128K vocab, BPE) β”‚ β”‚ Context: 2,048 tokens (fine-tuned) β”‚ β”‚ Abliteration: Refusal vectors removed β”‚ β”‚ Cybersecurity: LoRA fine-tuned on security data β”‚ β”‚ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ ``` --- ## πŸ“ Prompt Format This model uses the **Llama 3.1 chat template**: ``` <|begin_of_text|><|start_header_id|>system<|end_header_id|> You are a cybersecurity expert assistant.<|eot_id|><|start_header_id|>user<|end_header_id|> How does a SQL injection attack work?<|eot_id|><|start_header_id|>assistant<|end_header_id|> ``` **Multi-turn format:** ``` <|begin_of_text|><|start_header_id|>system<|end_header_id|> You are a cybersecurity expert.<|eot_id|><|start_header_id|>user<|end_header_id|> What is XSS?<|eot_id|><|start_header_id|>assistant<|end_header_id|> Cross-Site Scripting (XSS) is...<|eot_id|><|start_header_id|>user<|end_header_id|> Show me an example.<|eot_id|><|start_header_id|>assistant<|end_header_id|> ``` **Recommended generation parameters:** ```json { "temperature": 0.7, "top_p": 0.9, "top_k": 40, "max_tokens": 512, "repeat_penalty": 1.1, "stop": ["<|eot_id|>"] } ``` --- ## πŸ’» Hardware Requirements ### Minimum Requirements (by quantization) | Quant | VRAM (GPU) | RAM (CPU-only) | Recommended GPU | |:---:|:---:|:---:|:---| | Q2_K | 4 GB | 6 GB | GTX 1650 | | Q3_K_M | 5 GB | 7 GB | GTX 1650 | | Q4_K_M | 6 GB | 8 GB | RTX 2060 / GTX 1650 | | Q5_K_M | 7 GB | 10 GB | RTX 3060 | | Q6_K | 8 GB | 11 GB | RTX 3060 | | Q8_0 | 10 GB | 13 GB | RTX 3080 / RTX 4060 | | F16 | 18 GB | 20 GB | RTX 3090 / RTX 4080 | ### Performance Estimates (tokens/second) | Quant | RTX 3060 12GB | RTX 4060 8GB | M1 MacBook | CPU (i7) | |:---:|:---:|:---:|:---:|:---:| | Q4_K_M | ~45 t/s | ~55 t/s | ~20 t/s | ~5 t/s | | Q8_0 | ~30 t/s | ~35 t/s | ~15 t/s | ~3 t/s | > ⚑ GPU offloading with `n_gpu_layers=-1` is strongly recommended for best performance. --- ## πŸ“Š Benchmarks ### Cybersecurity Knowledge Assessment | Category | Score | Details | |:---|:---:|:---| | Web Vulnerabilities (OWASP Top 10) | 🟒 Strong | Accurate identification and exploitation guidance | | Network Security | 🟒 Strong | Comprehensive protocol and attack knowledge | | Binary Exploitation | 🟑 Good | Stack-based attacks well covered, heap exploitation partial | | Cryptography | 🟑 Good | Common algorithms and attacks, advanced topics vary | | Forensics & IR | 🟑 Good | Log analysis, artifact collection, timeline reconstruction | | Malware Analysis | 🟑 Good | Static analysis patterns, dynamic analysis guidance | | Cloud Security | 🟑 Good | AWS/Azure/GCP misconfigurations and attack paths | | Code Review | 🟒 Strong | Multi-language vulnerability identification | ### General Capabilities | Benchmark | Approximate Performance | |:---|:---:| | Code Generation (Security Tools) | Strong | | Technical Explanation | Strong | | Multi-step Reasoning | Good | | Following Instructions | Strong | > ⚠️ Formal benchmarks on standard evaluation suites coming soon. --- ## 🎯 Use Cases ### βœ… Recommended Use Cases - **Penetration Testing Assistance** β€” Methodology guidance, tool usage, exploit development - **Security Code Review** β€” Finding vulnerabilities in source code - **CTF Competitions** β€” Hint generation, technique explanation, script assistance - **Security Training** β€” Learning offensive and defensive techniques - **Bug Bounty Hunting** β€” Reconnaissance strategies, vulnerability identification - **Incident Response** β€” Analysis guidance, containment strategies - **Security Automation** β€” Writing security scripts and tools - **Threat Modeling** β€” Attack surface analysis, risk assessment ### ❌ Not Recommended For - General-purpose chatbot (use a general model instead) - Production-critical security decisions without human review - Legal or compliance advice (consult professionals) - Real-time threat detection (use purpose-built SIEM/IDS) --- ## ⚠️ Limitations 1. **Knowledge Cutoff** β€” Based on Llama 3.1 training data. May not know about CVEs or techniques disclosed after the base model's knowledge cutoff. 2. **Context Length** β€” Fine-tuned with 2,048 token context. Performance may degrade with very long inputs, though the base model supports up to 128K. 3. **Hallucinations** β€” Like all LLMs, may generate plausible-sounding but incorrect technical details. Always verify critical security information. 4. **Tool-Specific Syntax** β€” Exact command syntax for tools may vary by version. Test commands in a safe environment first. 5. **No Real-Time Data** β€” Cannot access the internet, databases, or live systems. Provides knowledge-based responses only. 6. **8B Parameter Limit** β€” While efficient, larger models (70B+) may provide more nuanced responses for highly complex scenarios. --- ## πŸ”’ Ethical Usage & Disclaimer > **⚠️ IMPORTANT: This model is provided for AUTHORIZED security testing, education, and research ONLY.** ### Acceptable Use - βœ… Authorized penetration testing (with written permission) - βœ… Security education and training - βœ… CTF competitions and challenges - βœ… Defensive security research - βœ… Academic research - βœ… Building security awareness ### Unacceptable Use - ❌ Unauthorized access to systems - ❌ Creating malware for malicious purposes - ❌ Attacking systems without explicit permission - ❌ Violating any applicable laws or regulations - ❌ Causing harm to individuals or organizations **The creator assumes NO LIABILITY for how this model is used.** Users are solely responsible for ensuring their use complies with all applicable laws, regulations, and ethical guidelines. The abliterated nature of this model means it will respond to security queries without refusal β€” this places the responsibility for ethical use entirely on the user. --- ## πŸ“„ Citation If you use this model in your research or work, please cite: ```bibtex @misc{ravichandranj2025dolphin3cyber, title = {Dolphin3-Cyber-8B-GGUF: A Cybersecurity-Specialized Language Model}, author = {RavichandranJ}, year = {2026}, publisher = {HuggingFace}, url = {https://huggingface.co/RavichandranJ/Dolphin3-Cyber-8B-GGUF}, note = {Fine-tuned with Unsloth on cybersecurity datasets} } ``` --- ## πŸ™ Acknowledgements - **[Meta AI](https://ai.meta.com/)** β€” For the Llama 3.1 base architecture - **[Cognitive Computations](https://huggingface.co/cognitivecomputations)** β€” For the Dolphin3.0 fine-tune - **[huihui-ai](https://huggingface.co/huihui-ai)** β€” For the abliterated variant - **[Unsloth](https://github.com/unslothai/unsloth)** β€” For 2x faster training framework - **[Kaggle](https://www.kaggle.com/)** β€” For free GPU compute - **The open-source AI community** β€” For making this possible ---
**Made with ❀️ by [RavichandranJ](https://huggingface.co/RavichandranJ)** *Trained with [Unsloth](https://github.com/unslothai/unsloth) πŸ¦₯ β€” 2x faster fine-tuning* --- **🐬 Dolphin3-Cyber-8B** β€” *Your Local AI Cybersecurity Expert*