初始化项目，由ModelHub XC社区提供模型
Model: Casual-Autopsy/L3-Super-Nova-RP-8B Source: Original Platform
This commit is contained in:
ModelHub XC
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
BIN
Card-Assets/NovaKid-Girl.jpeg
Normal file
BIN
Card-Assets/NovaKid-Girl.jpeg
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 295 KiB |
521
README.md
Normal file
521
README.md
Normal file
@@ -0,0 +1,521 @@
|
||||
---
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
language:
|
||||
- en
|
||||
license: llama3
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
- multi-step merge
|
||||
- not-for-all-audiences
|
||||
- nsfw
|
||||
- rp
|
||||
- roleplay
|
||||
- role-play
|
||||
- summarization
|
||||
- emotion classification
|
||||
base_model:
|
||||
- nothingiisreal/L3-8B-Celeste-v1
|
||||
- Nitral-AI/Hathor_Tahsin-L3-8B-v0.85
|
||||
- Sao10K/L3-8B-Stheno-v3.2
|
||||
- ChaoticNeutrals/Poppy_Porpoise-1.0-L3-8B
|
||||
- Sao10K/L3-8B-Lunaris-v1
|
||||
- turboderp/llama3-turbcat-instruct-8b
|
||||
- ChaoticNeutrals/Domain-Fusion-L3-8B
|
||||
- migtissera/Llama-3-8B-Synthia-v3.5
|
||||
- TheDrummer/Llama-3SOME-8B-v2
|
||||
- ChaoticNeutrals/Hathor_RP-v.01-L3-8B
|
||||
- TheSkullery/llama-3-cat-8b-instruct-v1
|
||||
- FPHam/L3-8B-Everything-COT
|
||||
- Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged
|
||||
- OEvortex/Emotional-llama-8B
|
||||
- lighteternal/Llama3-merge-biomed-8b
|
||||
- Casual-Autopsy/Llama3-merge-psychotherapy-8b
|
||||
- Sao10K/L3-8B-Tamamo-v1
|
||||
- ResplendentAI/Nymph_8B
|
||||
- ChaoticNeutrals/T-900-8B
|
||||
- Sao10K/L3-8B-Niitama-v1
|
||||
- bluuwhale/L3-SthenoMaidBlackroot-8B-V1
|
||||
- Hastagaras/Jamet-8B-L3-MK.V-Blackroot
|
||||
- Hastagaras/Halu-8B-Llama3-Blackroot
|
||||
- crestf411/L3-8B-sunfall-v0.4-stheno-v3.2
|
||||
---
|
||||
| <img src="https://huggingface.co/Casual-Autopsy/L3-Super-Nova-RP-8B/resolve/main/Card-Assets/NovaKid-Girl.jpeg" width="50%" height="50%" style="display: block; margin: auto;"> |
|
||||
|:---:|
|
||||
| Image generated by [mayonays_on_toast](https://civitai.com/user/mayonays_on_toast) - [Sauce](https://civitai.com/images/10153472) |
|
||||
***
|
||||
***
|
||||
***
|
||||
# L3-Super-Nova-RP-8B
|
||||
|
||||
This is a role-playing model designed with the goal of good creativity and intelligence to improve advance role-playing experiences. The aim of L3-Super-Nova-RP-8B is to be good at Chain-of-Thoughts, summarizing information, and recognizing emotions. It also includes data about the human body and mind in an attempt to enhance understanding and interaction within role-playing scenarios.
|
||||
|
||||
The model was developed using various methods in multiple merging steps. To boost creativity, it used techniques to strengthen and adjust its output which was paried with the newly released merge method. All merge calculations were done in float32 format and then converted to the usual bfloat16 during merging.
|
||||
|
||||
***
|
||||
***
|
||||
## Presets
|
||||
|
||||
***
|
||||
### Text Gen
|
||||
The current good starting preset for this model:
|
||||
[***Nova***](https://huggingface.co/Casual-Autopsy/L3-Super-Nova-RP-8B/tree/main/ST/TextGen%20Preset)(Ooba Only)
|
||||
|
||||
***
|
||||
### Context/Instruct
|
||||
[Virt-io's SillyTavern Presets](https://huggingface.co/Virt-io/SillyTavern-Presets) work really well with this.
|
||||
|
||||
***
|
||||
***
|
||||
## Usage Info
|
||||
|
||||
Some of the **INT** models were chosen with some of SillyTavern's features in mind, such as emotion based sprites, dynamic music, and pretty much any feature, extension, or STscript that uses sumarization. With that said, it's recommended to use SillyTavern as your front-end.
|
||||
|
||||
While not required, I'd recommend building the story string prompt with Lorebooks rather than using the Advance Formatting menu. The only thing you really need in the Story String prompt within Advance Formatting is the system prompt. Doing it this way tends to keep the character more consistent as the RP goes on as all character card info is locked to a certain depth rather than getting further and further away within the context.
|
||||
|
||||
***
|
||||
***
|
||||
## Quants
|
||||
|
||||
GGUF:
|
||||
- [Static GGUFs](https://huggingface.co/mradermacher/L3-Super-Nova-RP-8B-GGUF) by mradermacher
|
||||
- [Imatrix GGUFs](https://huggingface.co/mradermacher/L3-Super-Nova-RP-8B-i1-GGUF) by mradermacher
|
||||
|
||||
Exl2:
|
||||
- [8.0bpw-h8 Exl2](https://huggingface.co/Slvcxc/L3-Super-Nova-RP-8B-8.0bpw-h8-exl2) by Slvcxc
|
||||
|
||||
***
|
||||
***
|
||||
## Merge Info
|
||||
|
||||
The merge methods used were **Ties**, **Dare Ties**, **Breadcrumbs Ties**, **SLERP**, and **DELLA**.
|
||||
|
||||
The model was finished off with both **Merge Densification**, and **Negative Weighting** techniques to boost creativity.
|
||||
|
||||
All merging steps had the merge calculations done in **float32** and were output as **bfloat16**.
|
||||
|
||||
***
|
||||
### Models Merged
|
||||
|
||||
The following models were used to make this merge:
|
||||
* [nothingiisreal/L3-8B-Celeste-v1](https://huggingface.co/nothingiisreal/L3-8B-Celeste-v1)
|
||||
* [Nitral-AI/Hathor_Tahsin-L3-8B-v0.85](https://huggingface.co/Nitral-AI/Hathor_Tahsin-L3-8B-v0.85)
|
||||
* [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
|
||||
* [ChaoticNeutrals/Poppy_Porpoise-1.0-L3-8B](https://huggingface.co/ChaoticNeutrals/Poppy_Porpoise-1.0-L3-8B)
|
||||
* [Sao10K/L3-8B-Lunaris-v1](https://huggingface.co/Sao10K/L3-8B-Lunaris-v1)
|
||||
* [turboderp/llama3-turbcat-instruct-8b](https://huggingface.co/turboderp/llama3-turbcat-instruct-8b)
|
||||
* [ChaoticNeutrals/Domain-Fusion-L3-8B](https://huggingface.co/ChaoticNeutrals/Domain-Fusion-L3-8B)
|
||||
* [migtissera/Llama-3-8B-Synthia-v3.5](https://huggingface.co/migtissera/Llama-3-8B-Synthia-v3.5)
|
||||
* [TheDrummer/Llama-3SOME-8B-v2](https://huggingface.co/TheDrummer/Llama-3SOME-8B-v2)
|
||||
* [ChaoticNeutrals/Hathor_RP-v.01-L3-8B](https://huggingface.co/ChaoticNeutrals/Hathor_RP-v.01-L3-8B)
|
||||
* [TheSkullery/llama-3-cat-8b-instruct-v1](https://huggingface.co/TheSkullery/llama-3-cat-8b-instruct-v1)
|
||||
* [FPHam/L3-8B-Everything-COT](https://huggingface.co/FPHam/L3-8B-Everything-COT)
|
||||
* [Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged](https://huggingface.co/Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged)
|
||||
* [OEvortex/Emotional-llama-8B](https://huggingface.co/OEvortex/Emotional-llama-8B)
|
||||
* [lighteternal/Llama3-merge-biomed-8b](https://huggingface.co/lighteternal/Llama3-merge-biomed-8b)
|
||||
* [Casual-Autopsy/Llama3-merge-psychotherapy-8b](https://huggingface.co/Casual-Autopsy/Llama3-merge-psychotherapy-8b)
|
||||
* [Sao10K/L3-8B-Tamamo-v1](https://huggingface.co/Sao10K/L3-8B-Tamamo-v1)
|
||||
* [ResplendentAI/Nymph_8B](https://huggingface.co/ResplendentAI/Nymph_8B)
|
||||
* [ChaoticNeutrals/T-900-8B](https://huggingface.co/ChaoticNeutrals/T-900-8B)
|
||||
* [Sao10K/L3-8B-Niitama-v1](https://huggingface.co/Sao10K/L3-8B-Niitama-v1)
|
||||
* [bluuwhale/L3-SthenoMaidBlackroot-8B-V1](https://huggingface.co/bluuwhale/L3-SthenoMaidBlackroot-8B-V1)
|
||||
* [Hastagaras/Jamet-8B-L3-MK.V-Blackroot](https://huggingface.co/Hastagaras/Jamet-8B-L3-MK.V-Blackroot)
|
||||
* [Hastagaras/Halu-8B-Llama3-Blackroot](https://huggingface.co/Hastagaras/Halu-8B-Llama3-Blackroot)
|
||||
* [crestf411/L3-8B-sunfall-v0.4-stheno-v3.2](https://huggingface.co/crestf411/L3-8B-sunfall-v0.4-stheno-v3.2)
|
||||
|
||||
***
|
||||
***
|
||||
## Evaluation Results
|
||||
|
||||
***
|
||||
### Open LLM Leaderboard
|
||||
[LB Link](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
|
||||
|
||||
**Explaination for AI RP newbies:** IFEval is the most important evaluation for RP AIs as it determines how well it can follow OOC, Lorebooks, and most importantly character cards.
|
||||
The rest don't matter. At least not nearly as much as IFEval.
|
||||
|
||||
|Metric | Value|
|
||||
|:------------------|------:|
|
||||
|Avg. |N/A|
|
||||
|IFEval (0-Shot) |N/A|
|
||||
|BBH (3-Shot) |N/A|
|
||||
|MATH Lvl 5 (4-Shot)|N/A|
|
||||
|GPQA (0-shot) |N/A|
|
||||
|MuSR (0-shot) |N/A|
|
||||
|MMLU-PRO (5-shot) |N/A|
|
||||
|
||||
***
|
||||
### UGI Leaderboard
|
||||
[LB Link](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard)
|
||||
|
||||
Information about the metrics can be found at the bottom of the [UGI Leaderboard](https://huggingface.co/spaces/DontPlanToEnd/UGI-Leaderboard) in the respective tabs.
|
||||
|
||||
|Metric(UGI-Leaderboard) | Value | Value | Metric(Writing Style)|
|
||||
|:------------------------|:-----:|:-----:|----------------------:|
|
||||
|UGI(Avg.) |23.56 |0.199 |RegV1 |
|
||||
|W/10 |5.8 |0.218 |RegV2 |
|
||||
|Unruly |22.5 |0.15 |MyScore |
|
||||
|Internet |11.8 |8.34 |ASSS |
|
||||
|Stats |18.7 |10.26 |SMOG |
|
||||
|Writing |31.5 |1.76 |Yule |
|
||||
|PolContro |33.3 | | |
|
||||
|
||||
***
|
||||
***
|
||||
## Secret Sauce
|
||||
|
||||
The following YAML configs were used to make this merge.
|
||||
|
||||
***
|
||||
### Super-Nova-CRE_pt.1
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: nothingiisreal/L3-8B-Celeste-v1
|
||||
- model: Nitral-AI/Hathor_Tahsin-L3-8B-v0.85
|
||||
parameters:
|
||||
density: [0.35, 0.45, 0.5, 0.55, 0.65, 0.55, 0.5, 0.45, 0.35]
|
||||
weight: [0.495, 0.165, 0.165, 0.495, 0.495, 0.165, 0.165, 0.495]
|
||||
- model: Sao10K/L3-8B-Stheno-v3.2
|
||||
parameters:
|
||||
density: [0.65, 0.55, 0.5, 0.45, 0.35, 0.45, 0.5, 0.55, 0.65]
|
||||
weight: [0.165, 0.495, 0.495, 0.165, 0.165, 0.495, 0.495, 0.165]
|
||||
merge_method: dare_ties
|
||||
base_model: nothingiisreal/L3-8B-Celeste-v1
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-CRE_pt.2
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: nothingiisreal/L3-8B-Celeste-v1
|
||||
- model: ChaoticNeutrals/Poppy_Porpoise-1.0-L3-8B
|
||||
parameters:
|
||||
density: [0.35, 0.45, 0.5, 0.55, 0.65, 0.55, 0.5, 0.45, 0.35]
|
||||
weight: [0.165, 0.495, 0.495, 0.165, 0.165, 0.495, 0.495, 0.165]
|
||||
- model: Sao10K/L3-8B-Lunaris-v1
|
||||
parameters:
|
||||
density: [0.65, 0.55, 0.5, 0.45, 0.35, 0.45, 0.5, 0.55, 0.65]
|
||||
weight: [0.495, 0.165, 0.165, 0.495, 0.495, 0.165, 0.165, 0.495]
|
||||
merge_method: dare_ties
|
||||
base_model: nothingiisreal/L3-8B-Celeste-v1
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-UNC_pt.1
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: turboderp/llama3-turbcat-instruct-8b
|
||||
- model: ChaoticNeutrals/Domain-Fusion-L3-8B
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.495, 0.165, 0.165, 0.495, 0.495, 0.165, 0.165, 0.495]
|
||||
- model: migtissera/Llama-3-8B-Synthia-v3.5
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.165, 0.495, 0.495, 0.165, 0.165, 0.495, 0.495, 0.165]
|
||||
merge_method: dare_ties
|
||||
base_model: turboderp/llama3-turbcat-instruct-8b
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-UNC_pt.2
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: turboderp/llama3-turbcat-instruct-8b
|
||||
- model: TheDrummer/Llama-3SOME-8B-v2
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.165, 0.495, 0.495, 0.165, 0.165, 0.495, 0.495, 0.165]
|
||||
- model: ChaoticNeutrals/Hathor_RP-v.01-L3-8B
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.495, 0.165, 0.165, 0.495, 0.495, 0.165, 0.165, 0.495]
|
||||
merge_method: dare_ties
|
||||
base_model: turboderp/llama3-turbcat-instruct-8b
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-INT_pt.1
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: TheSkullery/llama-3-cat-8b-instruct-v1
|
||||
- model: FPHam/L3-8B-Everything-COT
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.139, 0.139, 0.208, 0.139, 0.208]
|
||||
- model: Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.139, 0.208, 0.139, 0.208, 0.139]
|
||||
- model: OEvortex/Emotional-llama-8B
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.208, 0.139, 0.208, 0.139, 0.139]
|
||||
- model: lighteternal/Llama3-merge-biomed-8b
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.208, 0.139, 0.139, 0.139, 0.208]
|
||||
- model: Casual-Autopsy/Llama3-merge-psychotherapy-8b
|
||||
parameters:
|
||||
density: 0.5
|
||||
weight: [0.139, 0.208, 0.139, 0.208, 0.139]
|
||||
merge_method: ties
|
||||
base_model: TheSkullery/llama-3-cat-8b-instruct-v1
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-INT_pt.2
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: TheSkullery/llama-3-cat-8b-instruct-v1
|
||||
- model: FPHam/L3-8B-Everything-COT
|
||||
parameters:
|
||||
density: 0.9
|
||||
gamma: 0.01
|
||||
weight: [0.139, 0.208, 0.208, 0.139, 0.139]
|
||||
- model: Ayush-1722/Meta-Llama-3-8B-Instruct-Summarize-v0.2-24K-LoRANET-Merged
|
||||
parameters:
|
||||
density: 0.9
|
||||
gamma: 0.01
|
||||
weight: [0.208, 0.139, 0.139, 0.139, 0.208]
|
||||
- model: OEvortex/Emotional-llama-8B
|
||||
parameters:
|
||||
density: 0.9
|
||||
gamma: 0.01
|
||||
weight: [0.139, 0.139, 0.208, 0.208, 0.139]
|
||||
- model: lighteternal/Llama3-merge-biomed-8b
|
||||
parameters:
|
||||
density: 0.9
|
||||
gamma: 0.01
|
||||
weight: [0.139, 0.208, 0.139, 0.208, 0.139]
|
||||
- model: Casual-Autopsy/Llama3-merge-psychotherapy-8b
|
||||
parameters:
|
||||
density: 0.9
|
||||
gamma: 0.01
|
||||
weight: [0.208, 0.139, 0.139, 0.139, 0.208]
|
||||
merge_method: breadcrumbs_ties
|
||||
base_model: TheSkullery/llama-3-cat-8b-instruct-v1
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-CRE
|
||||
|
||||
```yaml
|
||||
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-CRE_pt.1
|
||||
- model: Casual-Autopsy/Super-Nova-CRE_pt.2
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-CRE_pt.1
|
||||
parameters:
|
||||
t:
|
||||
- filter: self_attn
|
||||
value: [0.5, 0.3, 0.7, 0.5, 0.7, 0.3, 0.5, 0.3, 0.7, 0.5, 0.7, 0.3, 0.5]
|
||||
- filter: mlp
|
||||
value: [0.5, 0.7, 0.3, 0.5, 0.3, 0.7, 0.5, 0.7, 0.3, 0.5, 0.3, 0.7, 0.5]
|
||||
- value: 0.5
|
||||
embed_slerp: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-UNC
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-UNC_pt.1
|
||||
- model: Casual-Autopsy/Super-Nova-UNC_pt.2
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-UNC_pt.1
|
||||
parameters:
|
||||
t:
|
||||
- value: [0.5, 0.7, 0.3, 0.5, 0.3, 0.7, 0.5, 0.7, 0.3, 0.5, 0.3, 0.7, 0.5]
|
||||
embed_slerp: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-INT
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-INT_pt.1
|
||||
- model: Casual-Autopsy/Super-Nova-INT_pt.2
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-INT_pt.1
|
||||
parameters:
|
||||
t:
|
||||
- value: 0.5
|
||||
embed_slerp: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-RP_stp.1
|
||||
|
||||
```yaml
|
||||
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-CRE
|
||||
- model: asual-Autopsy/Super-Nova-UNC
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-CRE
|
||||
parameters:
|
||||
t:
|
||||
- value: [0.7, 0.5, 0.3, 0.25, 0.2, 0.25, 0.3, 0.5, 0.7]
|
||||
embed_slerp: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-RP_stp.2
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-RP_stp.1
|
||||
- model: Casual-Autopsy/Super-Nova-INT
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-RP_stp.1
|
||||
parameters:
|
||||
t:
|
||||
- value: [0.1, 0.15, 0.2, 0.4, 0.6, 0.4, 0.2, 0.15, 0.1]
|
||||
embed_slerp: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-RP_pt.1
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-RP_stp.2
|
||||
- model: Sao10K/L3-8B-Tamamo-v1
|
||||
parameters:
|
||||
density: [0.4, 0.6, 0.5, 0.6, 0.4]
|
||||
epsilon: [0.15, 0.15, 0.25, 0.15, 0.15]
|
||||
lambda: 0.85
|
||||
weight: [-0.01523, 0.01768, -0.01384, 0.01835, -0.01247]
|
||||
- model: ResplendentAI/Nymph_8B
|
||||
parameters:
|
||||
density: [0.65, 0.35, 0.5, 0.35, 0.65]
|
||||
epsilon: [0.1, 0.1, 0.25, 0.1, 0.1]
|
||||
lambda: 0.85
|
||||
weight: [0.01823, -0.01647, 0.01422, -0.01975, 0.01128]
|
||||
- model: ChaoticNeutrals/T-900-8B
|
||||
parameters:
|
||||
density: [0.35, 0.65, 0.5, 0.65, 0.35]
|
||||
epsilon: [0.1, 0.1, 0.25, 0.1, 0.1]
|
||||
lambda: 0.85
|
||||
weight: [-0.01891, 0.01554, -0.01325, 0.01791, -0.01458]
|
||||
- model: Sao10K/L3-8B-Niitama-v1
|
||||
parameters:
|
||||
density: [0.6, 0.4, 0.5, 0.4, 0.6]
|
||||
epsilon: [0.15, 0.15, 0.25, 0.15, 0.15]
|
||||
lambda: 0.85
|
||||
weight: [0.01768, -0.01675, 0.01285, -0.01696, 0.01421]
|
||||
merge_method: della
|
||||
base_model: Casual-Autopsy/Super-Nova-RP_stp.2
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### Super-Nova-RP_pt.2
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-RP_stp.2
|
||||
- model: bluuwhale/L3-SthenoMaidBlackroot-8B-V1
|
||||
parameters:
|
||||
density: [0.4, 0.6, 0.5, 0.6, 0.4]
|
||||
epsilon: [0.15, 0.15, 0.25, 0.15, 0.15]
|
||||
lambda: 0.85
|
||||
weight: [-0.01935, 0.01785, -0.01512, 0.01809, -0.01371]
|
||||
- model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
|
||||
parameters:
|
||||
density: [0.65, 0.35, 0.5, 0.35, 0.65]
|
||||
epsilon: [0.1, 0.1, 0.25, 0.1, 0.1]
|
||||
lambda: 0.85
|
||||
weight: [0.01847, -0.01468, 0.01503, -0.01822, 0.01459]
|
||||
- model: Hastagaras/Halu-8B-Llama3-Blackroot
|
||||
parameters:
|
||||
density: [0.35, 0.65, 0.5, 0.65, 0.35]
|
||||
epsilon: [0.1, 0.1, 0.25, 0.1, 0.1]
|
||||
lambda: 0.85
|
||||
weight: [-0.01578, 0.01821, -0.01753, 0.01677, -0.01442]
|
||||
- model: crestf411/L3-8B-sunfall-v0.4-stheno-v3.2
|
||||
parameters:
|
||||
density: [0.6, 0.5, 0.5, 0.5, 0.6]
|
||||
epsilon: [0.15, 0.15, 0.25, 0.15, 0.15]
|
||||
lambda: 0.85
|
||||
weight: [0.01667, -0.01740, 0.01560, -0.01564, 0.01315]
|
||||
merge_method: della
|
||||
base_model: Casual-Autopsy/Super-Nova-RP_stp.2
|
||||
parameters:
|
||||
normalize: false
|
||||
int8_mask: true
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
|
||||
***
|
||||
### L3-Super-Nova-RP-8B
|
||||
|
||||
```yaml
|
||||
models:
|
||||
- model: Casual-Autopsy/Super-Nova-RP_pt.1
|
||||
- model: Casual-Autopsy/Super-Nova-RP_pt.2
|
||||
merge_method: slerp
|
||||
base_model: Casual-Autopsy/Super-Nova-RP_pt.1
|
||||
parameters:
|
||||
t:
|
||||
- value: 0.5
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
```
|
||||
89
ST/Old/Nova.json
Normal file
89
ST/Old/Nova.json
Normal file
@@ -0,0 +1,89 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 1,
|
||||
"top_k": 80,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0.025,
|
||||
"rep_pen": 1,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.01,
|
||||
"freq_pen": 0.02,
|
||||
"presence_pen": 0.03,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": false,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.75,
|
||||
"max_temp": 1.5,
|
||||
"dynatemp_exponent": 0.85,
|
||||
"smoothing_factor": 0.35,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 0.8,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 2,
|
||||
"mirostat_tau": 8,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 512,
|
||||
"max_length": 8192
|
||||
}
|
||||
1
ST/QR sets/RP Tools - ADN(ICoT) Config.json
Normal file
1
ST/QR sets/RP Tools - ADN(ICoT) Config.json
Normal file
@@ -0,0 +1 @@
|
||||
{"version":2,"name":"RP Tools - CoT ADN Config","disableSend":false,"placeBeforeInput":false,"injectInput":false,"color":"rgba(0, 0, 0, 0)","onlyBorderColor":false,"qrList":[{"id":10,"icon":"fa-id-badge","showLabel":true,"label":"ADN - Role","title":"","message":"/buttons labels=[\"system\", \"user\", \"assistant\"] Set role. |\n/let button_output {{pipe}} |\n\n\n/if left=\"{{var::button_output}}\" right=\"\" rule=eq {:\n\t/abort quiet=false Canceled. Aborting.\n:} |\n\n/setvar key=audir_role {{var::button_output}} |\n\n/if left=audir_active right=true rule=eq {:\n\t/if left=\"{{getvar::audir_depth}}\" right=\"\" rule=eq else={:\n\t\t/pass {{getvar::audir_depth}}\n\t:}\n\t{:\n\t\t/pass 0\n\t:} |\n\t/let set_depth {{pipe}} |\n\t\n\t\n\t/echo Set role to '{{getvar::audir_role}}'. |\n\t/inject id=audir_inject position=chat depth={{var::set_depth}} role={{getvar::audir_role}} {{getvar::audir_cot}}\n:} |","contextList":[],"preventAutoExecute":true,"isHidden":false,"executeOnStartup":false,"executeOnUser":false,"executeOnAi":false,"executeOnChatChange":false,"executeOnGroupMemberDraft":false,"automationId":""},{"id":12,"icon":"fa-arrow-down-short-wide","showLabel":true,"label":"ADN - Depth","title":"","message":"/if left=\"{{getvar::audir_depth}}\" right=\"\" rule=eq else={:\n\t/input default=\"{{getvar::audir_depth}}\" Set prompt depth. |\n:}\n{:\n\t/input defualt=\"0\" Set prompt depth. |\n:} |\n/let input_depth {{pipe}} |\n\n\n/if left=\"{{var::input_depth}}\" right=\"\" rule=eq else={:\n\t/if left=input_depth right=0 rule=gte else={:\n\t\t/abort quiet=false Invalid input. Aborting. \n\t:}\n\t{:\n\t\t/setvar key=audir_depth {{var::input_depth}} |\n\t\t/echo Set depth to '{{var::input_depth}}'.\n\t:}\n:}\n{:\n\t/abort quiet=false Canceled. Aborting.\n:} |\n\n\n/if left=audir_active right=true rule=eq {:\n\t/if left=\"{{getvar::audir_role}}\" right=\"\" rule=eq else={:\n\t\t/pass {{getvar::audir_role}}\n\t:}\n\t{:\n\t\t/pass assistant\n\t:} |\n\t/let set_role {{pipe}} |\n\t\n\t/inject id=audir_inject position=chat depth={{getvar::audir_depth}} role={{var::set_role}} {{getvar::audir_cot}} |\n:}","contextList":[],"preventAutoExecute":true,"isHidden":false,"executeOnStartup":false,"executeOnUser":false,"executeOnAi":false,"executeOnChatChange":false,"executeOnGroupMemberDraft":false,"automationId":""},{"id":14,"icon":"fa-skull","showLabel":true,"label":"ADN - Remove","title":"","message":"/flushinject audir_inject |\n\n/flushvar audir_active |\n/flushvar audir_cot |","contextList":[],"preventAutoExecute":true,"isHidden":false,"executeOnStartup":false,"executeOnUser":false,"executeOnAi":false,"executeOnChatChange":false,"executeOnGroupMemberDraft":false,"automationId":""},{"id":4,"icon":"fa-dice","showLabel":true,"label":"ADN - Re-Roll","title":"","message":"/:\"RP Tools - CoT Auto Director's Note.Main\"","contextList":[],"preventAutoExecute":true,"isHidden":false,"executeOnStartup":false,"executeOnUser":false,"executeOnAi":false,"executeOnChatChange":false,"executeOnGroupMemberDraft":false,"automationId":""}],"idIndex":16}
|
||||
@@ -0,0 +1 @@
|
||||
{"version":2,"name":"RP Tools - CoT Auto Director's Note","disableSend":false,"placeBeforeInput":true,"injectInput":true,"color":"rgba(0, 0, 0, 0)","onlyBorderColor":false,"qrList":[{"id":2,"showLabel":false,"label":"Main","title":"","message":"/let cot_prompt \"[Pause the role-play\n{\nYou've been tasked with creating a story plan;\nConsidering the chat history, fill out the TEMPLATE to create a plan on how to continue the role-play's story;\nONLY OUTPUT THE STORY PLAN AND FOLLOW THE TEMPLATE SYNTAX EXACTLY, NOTHING ELSE;\n\nTEMPLATE:\n- I am {{char}}\n- My body is X Y Z\n- {{user}} is X\n- My special traits are X\n- My body placement is X\n- Me and {{user}} are X\n- My plan: X\n- Known factors: X Y\n- Unknown factors: X Y\n- I might be wrong about: X\n- Plan criticism: X\n- Better step by step plan: X Y Z\n- I will use that plan to continue the story further with slow pacing\n}]\" |\n\n/let cot_prefix \"[CoT\n{\n\" |\n\n/let cot_suffix \"\n}]\" |\n\n\n/if left=\"{{getvar::audir_active}}\" right=\"true\" rule=eq else={:\n\t/pass None\n:}\n{:\n\t/flushinject audir_inject\n:} |\n\n\n/gen lock=on as=system {{var::cot_prompt}} |\n/let cot_output {{pipe}} |\n\n/input default=\"{{var::cot_output}}\" rows=20 Check output. |\n/var key=cot_output {{pipe}} |\n\n\n/if left=\"{{var::cot_output}}\" right=\"\" rule=eq else={:\n\t/pass {{var::cot_prefix}}{{var::cot_output}}{{var::cot_suffix}}\n:}\n{:\n\t/abort quiet=false Empty prompt. Auto Director's Note canceled.\n:} |\n\n/var key=cot_output {{pipe}} |\n\n\n/if left=\"{{getvar::audir_depth}}\" right=\"\" rule=eq else={:\n\t/pass {{getvar::audir_depth}}\n:}\n{:\n\t/pass 0\n:} |\n/let cot_depth {{pipe}} |\n\n/if left=\"{{getvar::audir_role}}\" right=\"\" rule=eq else={:\n\t/pass {{getvar::audir_role}}\n:}\n{:\n\t/pass assistant\n:} |\n/let cot_role {{pipe}} |\n\n\n/inject id=audir_inject position=chat depth={{var::cot_depth}} role={{var::cot_role}} {{var::cot_output}} |\n\n/setvar key=audir_active true |\n/setvar key=audir_cot {{var::cot_output}} |","contextList":[],"preventAutoExecute":false,"isHidden":false,"executeOnStartup":false,"executeOnUser":true,"executeOnAi":false,"executeOnChatChange":false,"executeOnGroupMemberDraft":false,"automationId":""}],"idIndex":10}
|
||||
91
ST/TextGen Preset/Class A.json
Normal file
91
ST/TextGen Preset/Class A.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 1,
|
||||
"top_k": 0,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": false,
|
||||
"min_temp": 0,
|
||||
"max_temp": 1,
|
||||
"dynatemp_exponent": 1,
|
||||
"smoothing_factor": 0.3,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 1.2,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 2,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.15,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0.5,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 768,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class B.json
Normal file
91
ST/TextGen Preset/Class B.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 0.95,
|
||||
"top_k": 100,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1.03,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0.05,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.75,
|
||||
"max_temp": 1.5,
|
||||
"dynatemp_exponent": 0.85,
|
||||
"smoothing_factor": 0.3,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 1.2,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 0,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0.5,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 768,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class F.json
Normal file
91
ST/TextGen Preset/Class F.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 1,
|
||||
"top_k": 0,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": false,
|
||||
"min_temp": 0,
|
||||
"max_temp": 1,
|
||||
"dynatemp_exponent": 1,
|
||||
"smoothing_factor": 0.3,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 0.8,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 2,
|
||||
"mirostat_tau": 8,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0.5,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 768,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class G.json
Normal file
91
ST/TextGen Preset/Class G.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 0.95,
|
||||
"top_k": 100,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1.01,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0.02,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.45,
|
||||
"max_temp": 1.25,
|
||||
"dynatemp_exponent": 0.85,
|
||||
"smoothing_factor": 0.32,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 3,
|
||||
"dry_multiplier": 0.8,
|
||||
"dry_base": 1.5,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 0,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 1536,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class K.json
Normal file
91
ST/TextGen Preset/Class K.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 0.95,
|
||||
"top_k": 80,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1.01,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0.02,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.35,
|
||||
"max_temp": 1.25,
|
||||
"dynatemp_exponent": 0.85,
|
||||
"smoothing_factor": 0.35,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 3,
|
||||
"dry_multiplier": 0,
|
||||
"dry_base": 1.5,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 0,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 1536,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class M.json
Normal file
91
ST/TextGen Preset/Class M.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 1,
|
||||
"top_k": 60,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0.075,
|
||||
"rep_pen": 1,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.35,
|
||||
"max_temp": 1,
|
||||
"dynatemp_exponent": 1.15,
|
||||
"smoothing_factor": 0,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 0,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 0,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.15,
|
||||
"xtc_probability": 0,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 1536,
|
||||
"max_length": 12288
|
||||
}
|
||||
91
ST/TextGen Preset/Class O.json
Normal file
91
ST/TextGen Preset/Class O.json
Normal file
@@ -0,0 +1,91 @@
|
||||
{
|
||||
"temp": 1,
|
||||
"temperature_last": false,
|
||||
"top_p": 0.95,
|
||||
"top_k": 100,
|
||||
"top_a": 0,
|
||||
"tfs": 1,
|
||||
"epsilon_cutoff": 0,
|
||||
"eta_cutoff": 0,
|
||||
"typical_p": 1,
|
||||
"min_p": 0,
|
||||
"rep_pen": 1.03,
|
||||
"rep_pen_range": 2048,
|
||||
"rep_pen_decay": 0,
|
||||
"rep_pen_slope": 1,
|
||||
"no_repeat_ngram_size": 0,
|
||||
"penalty_alpha": 0,
|
||||
"num_beams": 1,
|
||||
"length_penalty": 1,
|
||||
"min_length": 0,
|
||||
"encoder_rep_pen": 1.02,
|
||||
"freq_pen": 0,
|
||||
"presence_pen": 0.05,
|
||||
"skew": 0,
|
||||
"do_sample": true,
|
||||
"early_stopping": true,
|
||||
"dynatemp": true,
|
||||
"min_temp": 0.75,
|
||||
"max_temp": 1.5,
|
||||
"dynatemp_exponent": 0.85,
|
||||
"smoothing_factor": 0.3,
|
||||
"smoothing_curve": 1,
|
||||
"dry_allowed_length": 2,
|
||||
"dry_multiplier": 1.2,
|
||||
"dry_base": 1.75,
|
||||
"dry_sequence_breakers": "[\"\\n\", \":\", \"\\\"\", \"*\", \"`\", \";\", \"<\", \"(\", \"{\", \"[\", \"]\", \"}\", \")\", \">\", \"|\", \"+\", \"=\"]",
|
||||
"dry_penalty_last_n": 4096,
|
||||
"add_bos_token": true,
|
||||
"ban_eos_token": false,
|
||||
"skip_special_tokens": true,
|
||||
"mirostat_mode": 0,
|
||||
"mirostat_tau": 9.9,
|
||||
"mirostat_eta": 0.05,
|
||||
"guidance_scale": 1,
|
||||
"negative_prompt": "",
|
||||
"grammar_string": "",
|
||||
"json_schema": {},
|
||||
"banned_tokens": "",
|
||||
"sampler_priority": [
|
||||
"top_k",
|
||||
"top_a",
|
||||
"epsilon_cutoff",
|
||||
"eta_cutoff",
|
||||
"tfs",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature",
|
||||
"dynamic_temperature",
|
||||
"quadratic_sampling",
|
||||
"mirostat"
|
||||
],
|
||||
"samplers": [
|
||||
"top_k",
|
||||
"tfs_z",
|
||||
"typical_p",
|
||||
"top_p",
|
||||
"min_p",
|
||||
"temperature"
|
||||
],
|
||||
"ignore_eos_token": false,
|
||||
"spaces_between_special_tokens": true,
|
||||
"speculative_ngram": false,
|
||||
"sampler_order": [
|
||||
6,
|
||||
0,
|
||||
1,
|
||||
3,
|
||||
4,
|
||||
2,
|
||||
5
|
||||
],
|
||||
"logit_bias": [],
|
||||
"xtc_threshold": 0.1,
|
||||
"xtc_probability": 0.45,
|
||||
"ignore_eos_token_aphrodite": false,
|
||||
"spaces_between_special_tokens_aphrodite": true,
|
||||
"rep_pen_size": 0,
|
||||
"genamt": 768,
|
||||
"max_length": 12288
|
||||
}
|
||||
29
config.json
Normal file
29
config.json
Normal file
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"_name_or_path": "/kaggle/input/super-nova-rp_pt.3/transformers/hf/1",
|
||||
"architectures": [
|
||||
"LlamaForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"bos_token_id": 128000,
|
||||
"eos_token_id": 128009,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 4096,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 14336,
|
||||
"max_position_embeddings": 8192,
|
||||
"mlp_bias": false,
|
||||
"model_type": "llama",
|
||||
"num_attention_heads": 32,
|
||||
"num_hidden_layers": 32,
|
||||
"num_key_value_heads": 8,
|
||||
"pretraining_tp": 1,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_scaling": null,
|
||||
"rope_theta": 500000.0,
|
||||
"tie_word_embeddings": false,
|
||||
"torch_dtype": "bfloat16",
|
||||
"transformers_version": "4.42.3",
|
||||
"use_cache": true,
|
||||
"vocab_size": 128256
|
||||
}
|
||||
11
mergekit_config.yml
Normal file
11
mergekit_config.yml
Normal file
@@ -0,0 +1,11 @@
|
||||
|
||||
models:
|
||||
- model: /kaggle/input/super-nova-rp_pt.3/transformers/hf/1
|
||||
- model: /kaggle/input/super-nova-rp_pt.4/transformers/hf/1
|
||||
merge_method: slerp
|
||||
base_model: /kaggle/input/super-nova-rp_pt.3/transformers/hf/1
|
||||
parameters:
|
||||
t:
|
||||
- value: 0.5
|
||||
dtype: float32
|
||||
out_dtype: bfloat16
|
||||
3
model-00001-of-00004.safetensors
Normal file
3
model-00001-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:57bd5e08ac4395e9831ad858252c6b4893f99394d13aca1c783630e7a87a4a0d
|
||||
size 4953586384
|
||||
3
model-00002-of-00004.safetensors
Normal file
3
model-00002-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c0ac5115fc6ddc04762323ef2c4d9f3a5f189d7e19a9c6eb5d241b0f306ccecb
|
||||
size 4999819336
|
||||
3
model-00003-of-00004.safetensors
Normal file
3
model-00003-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b7955ef4bf49228a5b3e7c5111d32a2b4a3b0033c0d72d9a1a54b180bd7d0229
|
||||
size 4915916144
|
||||
3
model-00004-of-00004.safetensors
Normal file
3
model-00004-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8bb424aa9910f41ddded6f764b40b433950068e0098bec869fb82692c7fff654
|
||||
size 1191234472
|
||||
1
model.safetensors.index.json
Normal file
1
model.safetensors.index.json
Normal file
File diff suppressed because one or more lines are too long
17
special_tokens_map.json
Normal file
17
special_tokens_map.json
Normal file
@@ -0,0 +1,17 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<|begin_of_text|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "<|eot_id|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": "<|eot_id|>"
|
||||
}
|
||||
410563
tokenizer.json
Normal file
410563
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
2065
tokenizer_config.json
Normal file
2065
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user