68 lines
1.8 KiB
Markdown
68 lines
1.8 KiB
Markdown
|
---
|
||
|
|
base_model:
|
||
|
|
- meta-llama/Llama-3.2-3B-Instruct
|
||
|
|
- Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated
|
||
|
|
license: cc-by-4.0
|
||
|
|
language:
|
||
|
|
- en
|
||
|
|
pipeline_tag: text-generation
|
||
|
|
library_name: transformers
|
||
|
|
tags:
|
||
|
|
- text-generation-inference
|
||
|
|
- quantized
|
||
|
|
- Imatrix
|
||
|
|
- Uncensored
|
||
|
|
- Abliterated
|
||
|
|
- Llama 3.2
|
||
|
|
- GGUF
|
||
|
|
---
|
||
|
|
|
||
|
|
# Model Card for Model ID
|
||
|
|
|
||
|
|
# VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF
|
||
|
|
|
||
|
|
|
||
|
|
|
||
|
|
### Model Description
|
||
|
|
Small but Capable
|
||
|
|
|
||
|
|
Fine-Tuned on Vast dataset of Conversations and Abliterated for freedom of use.
|
||
|
|
|
||
|
|
Able to Generate Human like text with high performance within its size.
|
||
|
|
|
||
|
|
It is very versatile when compared for it's size and Parameters and offers capability almost as good as Llama 3.1 8B Instruct
|
||
|
|
|
||
|
|
Feel free to Check it out!!
|
||
|
|
|
||
|
|
Check the safetensors version of the model here : [Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated)
|
||
|
|
|
||
|
|
[This model was trained for 5hrs on GPU T4 15gb vram]
|
||
|
|
|
||
|
|
|
||
|
|
- **Developed by:** Meta AI
|
||
|
|
- **Fine-Tuned by:** Devarui379
|
||
|
|
- **Model type:** Transformers
|
||
|
|
- **Language(s) (NLP):** English
|
||
|
|
- **License:** cc-by-4.0
|
||
|
|
|
||
|
|
### Model Sources [optional]
|
||
|
|
|
||
|
|
base model:meta-llama/Llama-3.2-3B-Instruct
|
||
|
|
- **Repository:** [VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF)
|
||
|
|
- **Demo:** Use LM Studio
|
||
|
|
|
||
|
|
## Uses
|
||
|
|
|
||
|
|
Use desired System prompt when using in LM Studio
|
||
|
|
The optimal chat template seems to be Jinja but feel free to test it out as you want!
|
||
|
|
|
||
|
|
|
||
|
|
## Technical Specifications
|
||
|
|
|
||
|
|
### Model Architecture and Objective
|
||
|
|
|
||
|
|
Llama 3.2
|
||
|
|
|
||
|
|
#### Hardware
|
||
|
|
|
||
|
|
NVIDIA TESLA T4 GPU 15GB VRAM
|