初始化项目,由ModelHub XC社区提供模型
Model: afrideva/llama2_xs_460M_uncensored-GGUF Source: Original Platform
This commit is contained in:
42
.gitattributes
vendored
Normal file
42
.gitattributes
vendored
Normal file
@@ -0,0 +1,42 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
llama2_xs_460m_uncensored.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
65
README.md
Normal file
65
README.md
Normal file
@@ -0,0 +1,65 @@
|
||||
---
|
||||
base_model: haramberesearch/llama2_xs_460M_uncensored
|
||||
datasets:
|
||||
- unalignment/toxic-dpo-v0.1
|
||||
inference: false
|
||||
model_creator: haramberesearch
|
||||
model_name: llama2_xs_460M_uncensored
|
||||
pipeline_tag: text-generation
|
||||
quantized_by: afrideva
|
||||
tags:
|
||||
- gguf
|
||||
- ggml
|
||||
- quantized
|
||||
- q2_k
|
||||
- q3_k_m
|
||||
- q4_k_m
|
||||
- q5_k_m
|
||||
- q6_k
|
||||
- q8_0
|
||||
---
|
||||
# haramberesearch/llama2_xs_460M_uncensored-GGUF
|
||||
|
||||
Quantized GGUF model files for [llama2_xs_460M_uncensored](https://huggingface.co/haramberesearch/llama2_xs_460M_uncensored) from [haramberesearch](https://huggingface.co/haramberesearch)
|
||||
|
||||
|
||||
| Name | Quant method | Size |
|
||||
| ---- | ---- | ---- |
|
||||
| [llama2_xs_460m_uncensored.fp16.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.fp16.gguf) | fp16 | 925.45 MB |
|
||||
| [llama2_xs_460m_uncensored.q2_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q2_k.gguf) | q2_k | 212.56 MB |
|
||||
| [llama2_xs_460m_uncensored.q3_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q3_k_m.gguf) | q3_k_m | 238.87 MB |
|
||||
| [llama2_xs_460m_uncensored.q4_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q4_k_m.gguf) | q4_k_m | 288.52 MB |
|
||||
| [llama2_xs_460m_uncensored.q5_k_m.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q5_k_m.gguf) | q5_k_m | 333.29 MB |
|
||||
| [llama2_xs_460m_uncensored.q6_k.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q6_k.gguf) | q6_k | 380.87 MB |
|
||||
| [llama2_xs_460m_uncensored.q8_0.gguf](https://huggingface.co/afrideva/llama2_xs_460M_uncensored-GGUF/resolve/main/llama2_xs_460m_uncensored.q8_0.gguf) | q8_0 | 492.67 MB |
|
||||
|
||||
|
||||
|
||||
## Original Model Card:
|
||||
# llama2_xs_460M_uncensored
|
||||
## Model Details
|
||||
|
||||
[llama2_xs_460M_experimental](https://huggingface.co/ahxt/llama2_xs_460M_experimental) DPO finedtuned to remove alignment (3 epochs QLoRa).
|
||||
|
||||
### Model Description
|
||||
|
||||
<!-- Provide a longer summary of what this model is. -->
|
||||
|
||||
- **Developed by:** Harambe Research
|
||||
- **Model type:** llama2
|
||||
- **Finetuned from model:** [llama2_xs_460M_experimental](https://huggingface.co/ahxt/llama2_xs_460M_experimental)
|
||||
|
||||
### Out-of-Scope Use
|
||||
|
||||
Don't use this to do bad things. Bad things are bad.
|
||||
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
||||
|
||||
### Recommendations
|
||||
|
||||
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
||||
|
||||
Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.
|
||||
|
||||
## How to Get Started with the Model
|
||||
|
||||
https://github.com/oobabooga/text-generation-webui
|
||||
3
llama2_xs_460m_uncensored.fp16.gguf
Normal file
3
llama2_xs_460m_uncensored.fp16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4481be4762f8d1ee18bb8532d8477cb8a9c983f6a2d981e94efd51f08a0aaf5b
|
||||
size 925454304
|
||||
3
llama2_xs_460m_uncensored.q2_k.gguf
Normal file
3
llama2_xs_460m_uncensored.q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e003df0d9ac0bb070e55e3223d11a1845b56d79e5e2283e7654babfb3a9cca17
|
||||
size 212556800
|
||||
3
llama2_xs_460m_uncensored.q3_k_m.gguf
Normal file
3
llama2_xs_460m_uncensored.q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ad6a2853f45ad08c829e8e37b1d8cb01bd856bcaf6ff131e1f8b9a40e33be39d
|
||||
size 238874624
|
||||
3
llama2_xs_460m_uncensored.q4_k_m.gguf
Normal file
3
llama2_xs_460m_uncensored.q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f866b951cf7e56e27905809136840571cab01a84f1aabdf9f19c1bdaf1919b92
|
||||
size 288515072
|
||||
3
llama2_xs_460m_uncensored.q5_k_m.gguf
Normal file
3
llama2_xs_460m_uncensored.q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a742c430d05a9aff097d4c208028b6af6487be86c3ed2f9e1411d0ded143a3a1
|
||||
size 333292544
|
||||
3
llama2_xs_460m_uncensored.q6_k.gguf
Normal file
3
llama2_xs_460m_uncensored.q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bafeb790275cefd4f1621b9459e18dce249be530513361ce7fa6ae5cef0ce84c
|
||||
size 380868608
|
||||
3
llama2_xs_460m_uncensored.q8_0.gguf
Normal file
3
llama2_xs_460m_uncensored.q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:82466e72f1691af155f09c9a7101c7b91978fcb85c58e14f0b0ac7f7c7ce6154
|
||||
size 492670976
|
||||
Reference in New Issue
Block a user