Files
llama2_xs_460M_uncensored-GGUF/README.md
ModelHub XC cef4eef795 初始化项目,由ModelHub XC社区提供模型
Model: afrideva/llama2_xs_460M_uncensored-GGUF
Source: Original Platform
2026-09-07 12:14:16 +08:00

2.8 KiB

base_model, datasets, inference, model_creator, model_name, pipeline_tag, quantized_by, tags
base_model datasets inference model_creator model_name pipeline_tag quantized_by tags
haramberesearch/llama2_xs_460M_uncensored
unalignment/toxic-dpo-v0.1
false haramberesearch llama2_xs_460M_uncensored text-generation afrideva
gguf
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0

haramberesearch/llama2_xs_460M_uncensored-GGUF

Quantized GGUF model files for llama2_xs_460M_uncensored from haramberesearch

Name Quant method Size
llama2_xs_460m_uncensored.fp16.gguf fp16 925.45 MB
llama2_xs_460m_uncensored.q2_k.gguf q2_k 212.56 MB
llama2_xs_460m_uncensored.q3_k_m.gguf q3_k_m 238.87 MB
llama2_xs_460m_uncensored.q4_k_m.gguf q4_k_m 288.52 MB
llama2_xs_460m_uncensored.q5_k_m.gguf q5_k_m 333.29 MB
llama2_xs_460m_uncensored.q6_k.gguf q6_k 380.87 MB
llama2_xs_460m_uncensored.q8_0.gguf q8_0 492.67 MB

Original Model Card:

llama2_xs_460M_uncensored

Model Details

llama2_xs_460M_experimental DPO finedtuned to remove alignment (3 epochs QLoRa).

Model Description

Out-of-Scope Use

Don't use this to do bad things. Bad things are bad.

Recommendations

Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.

How to Get Started with the Model

https://github.com/oobabooga/text-generation-webui