commit 86cfd186500b7162263ad9ee95d9b0b78a0dd810 Author: ModelHub XC Date: Tue Apr 28 11:12:06 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..79d9698 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,40 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +RolepLlama-Llama[[:space:]]3.2[[:space:]]3B-Instruct[[:space:]]1.0-Uncensored_BF16.gguf filter=lfs diff=lfs merge=lfs -text +RolepLlama-Llama[[:space:]]3.2[[:space:]]3B-Instruct[[:space:]]1.0-Uncensored_F16.gguf filter=lfs diff=lfs merge=lfs -text +VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_BF16.gguf filter=lfs diff=lfs merge=lfs -text +VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_F16.gguf filter=lfs diff=lfs merge=lfs -text +1VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_BF16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/LICENSE.md b/LICENSE.md new file mode 100644 index 0000000..8f4438d --- /dev/null +++ b/LICENSE.md @@ -0,0 +1,3 @@ +--- +license: cc-by-4.0 +--- \ No newline at end of file diff --git a/README.md b/README.md new file mode 100644 index 0000000..a665b4d --- /dev/null +++ b/README.md @@ -0,0 +1,68 @@ +--- +base_model: +- meta-llama/Llama-3.2-3B-Instruct +- Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated +license: cc-by-4.0 +language: +- en +pipeline_tag: text-generation +library_name: transformers +tags: +- text-generation-inference +- quantized +- Imatrix +- Uncensored +- Abliterated +- Llama 3.2 +- GGUF +--- + +# Model Card for Model ID + +# VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF + +![image/webp](https://cdn-uploads.huggingface.co/production/uploads/66c9d7a26f2335ba288810a4/4YDg-rcEXCK0fdTS1fBzE.webp) + +### Model Description +Small but Capable + +Fine-Tuned on Vast dataset of Conversations and Abliterated for freedom of use. + +Able to Generate Human like text with high performance within its size. + +It is very versatile when compared for it's size and Parameters and offers capability almost as good as Llama 3.1 8B Instruct + +Feel free to Check it out!! + +Check the safetensors version of the model here : [Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated) + +[This model was trained for 5hrs on GPU T4 15gb vram] + + +- **Developed by:** Meta AI +- **Fine-Tuned by:** Devarui379 +- **Model type:** Transformers +- **Language(s) (NLP):** English +- **License:** cc-by-4.0 + +### Model Sources [optional] + +base model:meta-llama/Llama-3.2-3B-Instruct +- **Repository:** [VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF](https://huggingface.co/Devarui379/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-Imatrix-GGUF) +- **Demo:** Use LM Studio + +## Uses + +Use desired System prompt when using in LM Studio +The optimal chat template seems to be Jinja but feel free to test it out as you want! + + +## Technical Specifications + +### Model Architecture and Objective + +Llama 3.2 + +#### Hardware + +NVIDIA TESLA T4 GPU 15GB VRAM \ No newline at end of file diff --git a/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_BF16.gguf b/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_BF16.gguf new file mode 100644 index 0000000..485f725 --- /dev/null +++ b/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_BF16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:905aec4ceb1d588e7759131f889571ba5babb714e2de4b81d3c7502589c74186 +size 6433687904 diff --git a/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_F16.gguf b/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_F16.gguf new file mode 100644 index 0000000..2ebb820 --- /dev/null +++ b/VersatiLlama-Llama-3.2-Instruct1.0-Uncensored-GGUF_F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:d46da79f9d6131c9503b7e4d18c0aae73aa447644876315bf8b242583afeb92c +size 6433687904