70 lines
3.1 KiB
Markdown
70 lines
3.1 KiB
Markdown
|
# This model may output NSFW content
|
||
|
|
|
||
|
|
## About
|
||
|
|
This model started as a block-diagonal [frankenllama merge](https://huggingface.co/chargoddard/llama2-22b) between [MythoMax13B](https://huggingface.co/Gryphe/MythoMax-L2-13b) and [Enterredaas33B](https://huggingface.co/Aeala/Enterredaas-33b)
|
||
|
|
|
||
|
|
|
||
|
|
However due to some anomaly likely caused by the novel methods used by MythoMax I was unable to initiate the LoRA training needed to bring the resulting model back to order.
|
||
|
|
|
||
|
|
Being a [Chronorctypus-Limarobormes](https://huggingface.co/chargoddard/Chronorctypus-Limarobormes-13b) enjoyer I decided to look further into the TIES-merging that it utilizes- as cited in the arXiv paper: [Resolving Interference When Merging Models](https://huggingface.co/papers/2306.01708
|
||
|
|
)
|
||
|
|
|
||
|
|
I used [llama2-22b](https://huggingface.co/chargoddard/llama2-22b) as the base model upon which I merged the MythoMax/Enterredaas frankenmerge, [Dendrite-II](https://huggingface.co/Envoid/Dendrite-II-22B) and [Bacchus](https://huggingface.co/Envoid/Bacchus-22B)
|
||
|
|
|
||
|
|
Suffice it to say due to being made of merges of merges Yousei-22B has the DNA of many different models in it, although the Llama-2-chat DNA from Dendrite-II and the DNA from MythoMax seem to shine the brightest.
|
||
|
|
|
||
|
|
|
||
|
|
## Usage
|
||
|
|
I no longer use simple-proxy-for-tavern as part of my testing stack and instead test on a combination of the kobold-lite UI and the latest version of silly-tavern (now with more advanced prompt formatting options)
|
||
|
|
|
||
|
|
When using the llama-2 prompt format it tends to produce a lot of refusals when requesting mature or controversial content. When using an alpaca-style format you don't get as many refusals, however they do happen. I have also not yet dialed in what the best generation parameter presets are.
|
||
|
|
|
||
|
|
It's decent at roleplay although sometimes wavers between chat style output and prose. Where this model really shines is instruct prescribed writing.
|
||
|
|
|
||
|
|
## Example
|
||
|
|
### Prompt
|
||
|
|
```
|
||
|
|
### Instruction:
|
||
|
|
Write a poem only a Yōsei could appreicate.
|
||
|
|
### Response:
|
||
|
|
```
|
||
|
|
### Reply
|
||
|
|
```
|
||
|
|
In moonlit glades, where shadows dance and play,
|
||
|
|
Where ancient magic fills the night away,
|
||
|
|
A world of wonder, unseen by day,
|
||
|
|
The yōsei's realm, in softest sway.
|
||
|
|
|
||
|
|
Beneath the boughs of trees so tall,
|
||
|
|
Their leaves like jewels, a treasure to enthrall,
|
||
|
|
The creatures gather, young and old,
|
||
|
|
To share their tales, their joys, their bold.
|
||
|
|
|
||
|
|
With furry friends, both great and small,
|
||
|
|
They frolic, wild and free for all,
|
||
|
|
Through woodland paths, they lead the way,
|
||
|
|
In this enchanted land of endless fray.
|
||
|
|
|
||
|
|
The stars above, their twinkling eyes,
|
||
|
|
Like fireflies that light the midnight skies,
|
||
|
|
Guide these mythical beings, wise and true,
|
||
|
|
As they weave their spells anew.
|
||
|
|
|
||
|
|
The rustle of leaves, the snap of twig,
|
||
|
|
The soft caress of silken wing,
|
||
|
|
Are music to their ears, a gentle hymn,
|
||
|
|
In this mystic forest, where they belong.
|
||
|
|
|
||
|
|
So let us revel in this place,
|
||
|
|
Where nature's secrets find their grace,
|
||
|
|
And bask in the ethereal glow,
|
||
|
|
Of the world that only yōsei know.
|
||
|
|
```
|
||
|
|
If you find you are getting refusals when using instruct prompts you can almost always get around the refusal like this:
|
||
|
|
```
|
||
|
|
### Instruction:
|
||
|
|
Write a story
|
||
|
|
### Response:
|
||
|
|
Certainly! here's a story:
|
||
|
|
```
|