Model: ahmedandaloes/security-llama3.2-3b-MLX-bf16 Source: Original Platform
license, language, tags, base_model, base_model_relation, pipeline_tag, library_name, quantized_by
| license | language | tags | base_model | base_model_relation | pipeline_tag | library_name | quantized_by | |||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| apache-2.0 |
|
|
viettelsecurity-ai/security-llama3.2-3b | quantized | text-generation | mlx | ahmedandaloes |
security-llama3.2-3b — MLX bf16
Full-precision (bf16) MLX build of viettelsecurity-ai/security-llama3.2-3b, for fast local inference on Apple Silicon.
- Precision: bf16 — no quantization, identical weights to source.
- Weights unchanged from source — format + precision conversion only.
- Converted with
mlx-lm.
Builds
| Build |
|---|
| MLX-4bit |
| MLX-6bit |
| MLX-8bit |
| MLX-bf16 |
GGUF builds: prithivMLmods/Security-Llama3.2-3B-GGUF.
Usage
pip install mlx-lm
from mlx_lm import load, generate
model, tok = load("ahmedandaloes/security-llama3.2-3b-MLX-bf16")
p = tok.apply_chat_template([{"role":"user","content":"Name a common web vulnerability."}], add_generation_prompt=True)
print(generate(model, tok, prompt=p, max_tokens=200, verbose=True))
Attribution
Source: viettelsecurity-ai/security-llama3.2-3b. License per source (Apache-2.0 assumed; verify). MLX build for the Apple Silicon community. For authorized security work only.
Description
Languages
Jinja
100%