prithivMLmods/Security-Llama3.2-3B-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: prithivMLmods/Security-Llama3.2-3B-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-08 03:33:12 +08:00
commit 64be14b8b8
23 changed files with 176 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

67
.gitattributes vendored Normal file
View File

@@ -0,0 +1,67 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.F32.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q4_K.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.BF16.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.F16.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q5_K.gguf filter=lfs diff=lfs merge=lfs -text
security-llama3.2-3b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

48
README.md Normal file
View File

@@ -0,0 +1,48 @@
---
license: llama3.2
base_model:
- viettelsecurity-ai/security-llama3.2-3b
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- text-generation-inference
---
# **Security-Llama3.2-3B-GGUF**
> security-llama3.2-3b is a dense, decoder-only Transformer model with approximately 3 billion parameters. It is optimized for generating text, particularly in response to prompts in a chat format, with a context length of up to 4,000 tokens. The model is specialized toward cybersecurity content, drawing on a mixture of publicly available blogs, papers, reference datasets (e.g. from the PEASEC cybersecurity repository), synthetic “textbook-style” data, and academic Q&A sources to enhance performance in security-themed tasks. For usage, the model accepts chat-style inputs (e.g. alternating “user” / “assistant” messages) and can be deployed via the Hugging Face transformers library (e.g. via pipeline("text-generation", model="viettelsecurity-ai/security-llama3.2-3b")). The model weights are stored in safetensors format, configured with fp16 (half precision), and no inference provider currently hosts it by default.
## Model Files
| File Name | Quant Type | File Size |
| - | - | - |
| security-llama3.2-3b.BF16.gguf | BF16 | 6.43 GB |
| security-llama3.2-3b.F16.gguf | F16 | 6.43 GB |
| security-llama3.2-3b.F32.gguf | F32 | 12.9 GB |
| security-llama3.2-3b.Q2_K.gguf | Q2_K | 1.36 GB |
| security-llama3.2-3b.Q3_K_L.gguf | Q3_K_L | 1.82 GB |
| security-llama3.2-3b.Q3_K_M.gguf | Q3_K_M | 1.69 GB |
| security-llama3.2-3b.Q3_K_S.gguf | Q3_K_S | 1.54 GB |
| security-llama3.2-3b.Q4_0.gguf | Q4_0 | 1.92 GB |
| security-llama3.2-3b.Q4_1.gguf | Q4_1 | 2.09 GB |
| security-llama3.2-3b.Q4_K.gguf | Q4_K | 2.02 GB |
| security-llama3.2-3b.Q4_K_M.gguf | Q4_K_M | 2.02 GB |
| security-llama3.2-3b.Q4_K_S.gguf | Q4_K_S | 1.93 GB |
| security-llama3.2-3b.Q5_0.gguf | Q5_0 | 2.27 GB |
| security-llama3.2-3b.Q5_1.gguf | Q5_1 | 2.45 GB |
| security-llama3.2-3b.Q5_K.gguf | Q5_K | 2.32 GB |
| security-llama3.2-3b.Q5_K_M.gguf | Q5_K_M | 2.32 GB |
| security-llama3.2-3b.Q5_K_S.gguf | Q5_K_S | 2.27 GB |
| security-llama3.2-3b.Q6_K.gguf | Q6_K | 2.64 GB |
| security-llama3.2-3b.Q8_0.gguf | Q8_0 | 3.42 GB |
## Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant
types (lower is better):
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)

3
config.json Normal file
View File

@@ -0,0 +1,3 @@
{
"model_type": "llama"
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

3
security-llama3.2-3b.BF16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e11f2ab7856c8360536d0f7648d0461588ea0d49f4fb29a8a653d6c8daf8c090
size 6433688480

3
security-llama3.2-3b.F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa7e6b1a9ccc8a4141da7f6d730b12b0af877a3e92b4c76c43f2d71b9ff0b5ce
size 6433688480

3
security-llama3.2-3b.F32.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b0e0395f28a422c57b98e8d346f0a4a9b5bb8a35ef07dcf9eec5f01c423de73c
size 12858837920

3
security-llama3.2-3b.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5dc7883e29eef64bb54f6b10b4046498845bb70321de1ce196b40b299da7041f
size 1363936160

3
security-llama3.2-3b.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:255ae89ff0023877c6c0bcb98a342ecc789681a88c69c34ea9b2dd33c39b173e
size 1815348128

3
security-llama3.2-3b.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8affb91f838f66c0a1b0ad3a8076664efc10755b53fbd75439c53767bedc8c41
size 1687159712

3
security-llama3.2-3b.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20f8168ed851f8b8f92cf8151dd01890d79544c6fa8e2cffe957b84e7dff44a3
size 1542849440

3
security-llama3.2-3b.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1877c9942bb92cd4f80b31332501dcdb607a532cd99811e78480946b533950eb
size 1917191072

3
security-llama3.2-3b.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fbb9b24d8d31e46c6da5a621d4cdccf19f4bb20431251ec922b2bafcd5ae2209
size 2093351840

3
security-llama3.2-3b.Q4_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae2dde7eb4484dd088539350f1a947830856394038af901ef9239ddfc7733266
size 2019378080

3
security-llama3.2-3b.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ae2dde7eb4484dd088539350f1a947830856394038af901ef9239ddfc7733266
size 2019378080

3
security-llama3.2-3b.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:389601fa5fe5a750bbfe3d4894ea80335725ccca20046baefbb39fb1045867a1
size 1928201120

3
security-llama3.2-3b.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9a7bf65fdfbbcca952fac20e799595400263341584ed866ddd987c7ac4a93624
size 2269512608

3
security-llama3.2-3b.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:96bdefad923105380698d0f69c706d32ff4b73cae3f66c6e7b1324d76abaa73e
size 2445673376

3
security-llama3.2-3b.Q5_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79fecc0514618f27b160db9ceb2211b425d31f3096b503502dc32198a8f9bd3c
size 2322154400

3
security-llama3.2-3b.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79fecc0514618f27b160db9ceb2211b425d31f3096b503502dc32198a8f9bd3c
size 2322154400

3
security-llama3.2-3b.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fcb62d22e2b6844b9c59a593f87b5f4a0f14a51ca9f4abba9467ac8bb73f1ec0
size 2269512608

3
security-llama3.2-3b.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:57780662b229c7e22c577eceec40111e8e36384d4a15e3bec6282e77f95ba570
size 2643854240

3
security-llama3.2-3b.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6c9d125612068ee16c4e0cf1d89aa1e497458eca34da98398d4e361c182cd76e
size 3421899680