初始化项目,由ModelHub XC社区提供模型
Model: QuixiAI/Llama-3-8B-Instruct-abliterated-v2 Source: Original Platform
This commit is contained in:
30
README.md
Normal file
30
README.md
Normal file
@@ -0,0 +1,30 @@
|
||||
---
|
||||
library_name: transformers
|
||||
license: llama3
|
||||
---
|
||||
|
||||
# Model Card for Llama-3-8B-Instruct-abliterated-v2
|
||||
|
||||
## Overview
|
||||
This model card describes the Llama-3-8B-Instruct-abliterated-v2 model, which is an orthogonalized version of the meta-llama/Llama-3-8B-Instruct model, and an improvement upon the previous generation Llama-3-8B-Instruct-abliterated. This variant has had certain weights manipulated to inhibit the model's ability to express refusal.
|
||||
|
||||
[Join the Cognitive Computations Discord!](https://discord.gg/cognitivecomputations)
|
||||
|
||||
## Details
|
||||
|
||||
* The model was trained with more data to better pinpoint the "refusal direction".
|
||||
* This model is MUCH better at directly and succinctly answering requests without producing even so much as disclaimers.
|
||||
|
||||
## Methodology
|
||||
|
||||
The methodology used to generate this model is described in the preview paper/blog post: '[Refusal in LLMs is mediated by a single direction](https://www.alignmentforum.org/posts/jGuXSZgv6qfdhMCuJ/refusal-in-llms-is-mediated-by-a-single-direction)'
|
||||
|
||||
## Quirks and Side Effects
|
||||
This model may come with interesting quirks, as the methodology is still new and untested. The code used to generate the model is available in the Python notebook [ortho_cookbook.ipynb](https://huggingface.co/failspy/llama-3-70B-Instruct-abliterated/blob/main/ortho_cookbook.ipynb).
|
||||
Please note that the model may still refuse to answer certain requests, even after the weights have been manipulated to inhibit refusal.
|
||||
|
||||
## Availability
|
||||
|
||||
## How to Use
|
||||
This model is available for use in the Transformers library.
|
||||
GGUF Quants are available [here](https://huggingface.co/failspy/Llama-3-8B-Instruct-abliterated-v2-GGUF).
|
||||
Reference in New Issue
Block a user