base_model, datasets, inference, model_creator, model_name, pipeline_tag, quantized_by, tags

base_model	datasets	inference	model_creator	model_name	pipeline_tag	quantized_by	tags
haramberesearch/llama2_xs_460M_uncensored	unalignment/toxic-dpo-v0.1	false	haramberesearch	llama2_xs_460M_uncensored	text-generation	afrideva	gguf ggml quantized q2_k q3_k_m q4_k_m q5_k_m q6_k q8_0

haramberesearch/llama2_xs_460M_uncensored-GGUF

Quantized GGUF model files for llama2_xs_460M_uncensored from haramberesearch

Name	Quant method	Size
llama2_xs_460m_uncensored.fp16.gguf	fp16	925.45 MB
llama2_xs_460m_uncensored.q2_k.gguf	q2_k	212.56 MB
llama2_xs_460m_uncensored.q3_k_m.gguf	q3_k_m	238.87 MB
llama2_xs_460m_uncensored.q4_k_m.gguf	q4_k_m	288.52 MB
llama2_xs_460m_uncensored.q5_k_m.gguf	q5_k_m	333.29 MB
llama2_xs_460m_uncensored.q6_k.gguf	q6_k	380.87 MB
llama2_xs_460m_uncensored.q8_0.gguf	q8_0	492.67 MB

Original Model Card:

llama2_xs_460M_uncensored

Model Details

llama2_xs_460M_experimental DPO finedtuned to remove alignment (3 epochs QLoRa).

Model Description

• Developed by: Harambe Research
• Model type: llama2
• Finetuned from model: llama2_xs_460M_experimental

Out-of-Scope Use

Don't use this to do bad things. Bad things are bad.

Recommendations

Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.

How to Get Started with the Model

https://github.com/oobabooga/text-generation-webui