初始化项目,由ModelHub XC社区提供模型
Model: allura-org/TQ2.5-14B-Aletheia-v1 Source: Original Platform
This commit is contained in:
91
README.md
Normal file
91
README.md
Normal file
@@ -0,0 +1,91 @@
|
||||
---
|
||||
base_model:
|
||||
- allura-org/TQ2.5-14B-Neon-v1
|
||||
- allura-org/TQ2.5-14B-Sugarquill-v1
|
||||
library_name: transformers
|
||||
tags:
|
||||
- mergekit
|
||||
- merge
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
---
|
||||
|
||||
<img src="aletheia.png">
|
||||
<small>Image by CalamitousFelicitousness</small>
|
||||
|
||||
---
|
||||
|
||||
|
||||
# Qwen2.5-14B Aletheia v1
|
||||
|
||||
RP/Story hybrid model, merge of Sugarquill and Neon. As with Gemma version, I wanted to preserve Sugarquill's creative spark, while making the model more steerable for RP. It proved to be more difficult this time, but I quite like the result regardless, even if the model is still somewhat temperamental.
|
||||
|
||||
Should work for both RP and storywriting, either on raw completion or with back-and-forth cowriting in chat mode. Seems to be quite sensitive to low depth instructions and samplers.
|
||||
|
||||
Thanks to Toasty and Fizz for testing and giving feedback
|
||||
|
||||
Model was created by Auri.
|
||||
|
||||
---
|
||||
|
||||
**Notes about merging**
|
||||
|
||||
It took me 20 something attempts to make this model. TIES didn't work at all, producing broken or nearly broken results every time. SLERP worked much better and after just 3 attempts I got something I like.
|
||||
Sugarquill was really prone to overtaking the merge, so I had to reduce it's part a lot, and still model has a lot of influence from it.
|
||||
|
||||
**Format**
|
||||
|
||||
Model responds to ChatML instruct formatting, exactly like it's base model.
|
||||
|
||||
```
|
||||
<|im_start|>system
|
||||
{system message}<|im_end|>
|
||||
<|im_start|>user
|
||||
{user message}<|im_end|>
|
||||
<|im_start|>assistant
|
||||
{response}<|im_end|>
|
||||
```
|
||||
|
||||
**Recommended Samplers**
|
||||
|
||||
This one is a bit of a special snowflake, with special tastes. Those seem to work pretty well:
|
||||
|
||||
```
|
||||
Temperature - 0.8
|
||||
Top-A - 0.3
|
||||
TFS - 0.75
|
||||
DRY - Multiplier 0.8 - Base 1.75 - Allowed length 3 - Range 1024
|
||||
```
|
||||
|
||||
As a starting point, you can try this [ST Master Import](https://huggingface.co/allura-org/TQ2.5-14B-Aletheia-v1/blob/main/TQ-Aletheia.json)
|
||||
|
||||
## Merge Details
|
||||
### Merge Method
|
||||
|
||||
This model was merged using the SLERP merge method.
|
||||
|
||||
### Models Merged
|
||||
|
||||
The following models were included in the merge:
|
||||
* [allura-org/TQ2.5-14B-Neon-v1](https://huggingface.co/allura-org/TQ2.5-14B-Neon-v1)
|
||||
* [allura-org/TQ2.5-14B-Sugarquill-v1](https://huggingface.co/allura-org/TQ2.5-14B-Sugarquill-v1)
|
||||
|
||||
### Configuration
|
||||
|
||||
The following YAML configuration was used to produce this model:
|
||||
|
||||
```yaml
|
||||
base_model: allura-org/TQ2.5-14B-Sugarquill-v1
|
||||
dtype: bfloat16
|
||||
merge_method: slerp
|
||||
parameters:
|
||||
t:
|
||||
- value: 0.7
|
||||
slices:
|
||||
- sources:
|
||||
- layer_range: [0, 48]
|
||||
model: allura-org/TQ2.5-14B-Neon-v1
|
||||
- layer_range: [0, 48]
|
||||
model: allura-org/TQ2.5-14B-Sugarquill-v1
|
||||
```
|
||||
Reference in New Issue
Block a user