初始化项目,由ModelHub XC社区提供模型
Model: athirdpath/Iambe-RP-DARE-20b Source: Original Platform
This commit is contained in:
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
95
README.md
Normal file
95
README.md
Normal file
@@ -0,0 +1,95 @@
|
||||
---
|
||||
license: cc-by-nc-4.0
|
||||
language:
|
||||
- en
|
||||
tags:
|
||||
- not-for-all-audiences
|
||||
---
|
||||
<p align="center"><img src="https://i.ibb.co/PCY2Xym/Iambe-RP-sml-t.png"/><font size="6"> <b>Iambe-RP-DARE-20b</b> </font></p>
|
||||
<p align="center"><font size="4"> <b>Trained with Alpaca prompt formatting, ChatML works well too</b> </font></p>
|
||||
|
||||
### Description
|
||||
|
||||
3 Iambe-RPs bounce off the walls and blend, like their namesake's mother, Echo...
|
||||
|
||||
<i>[One daughter](https://huggingface.co/athirdpath/Iambe-RP-cDPO-20b) was excellent at all the arts and sciences, but she danced free, loathe to read scripts or follow instructions.
|
||||
|
||||
[Another daughter](https://huggingface.co/athirdpath/Iambe-RP-cDPO-20b-ALT) had burned her books, embraced emotion, and thrown logic to the hounds.
|
||||
|
||||
[The last daughter](https://huggingface.co/athirdpath/Iambe-RP-cDPO-20b-v2) just sat, watching them - silently judging - for enforcing morality was her burden alone.
|
||||
|
||||
Then, where there was three, there was one.</i>
|
||||
|
||||
Iambe is intended to have the best realistically possible understanding of instructions, anatomy and scene state for a 20b merge, while remaining passionate and humanoid in "voice".
|
||||
|
||||
### Update Methodology
|
||||
|
||||
All three Iambe-RPs had incredible strength, but also glaring issues. I couldn't decide so I figured, hey, "por que no los tres?"
|
||||
|
||||
Hopefully, this enhances the lucidity even more and fixes the typographical errors.
|
||||
|
||||
<p align="center"><font size="5"> <b>Assistant Example @ q5_k_m</b> </font></p>
|
||||
<p align="center"><img src="https://i.ibb.co/fY2pGtM/Screenshot-2023-12-10-030938.png"/>
|
||||
<p align="center"><img src="https://i.ibb.co/1nLLXNG/Screenshot-2023-12-10-122952.png"/>
|
||||
<p align="center"><img src="https://i.ibb.co/N3zd5Hr/Screenshot-2023-12-10-124038.png"/>
|
||||
|
||||
<p align="center"><font size="5"> <b>NSFW Writing Example @ q5_k_m</b> </font></p>
|
||||
|
||||
<b>Write a medium-length story about Alice, a 26 year old cocktail waitress, having steamy sex with a guy she picked up at the bar for a one night stand.</b>
|
||||
|
||||
<i>
|
||||
|
||||
Once upon a time, in a dimly lit corner of the trendiest bar downtown, Alice found herself growing bored by another slow night serving drinks to patrons who barely acknowledged her presence. As an attractive 26-year-old cocktail waitress with voluptuous curves and mesmerizing eyes, she had become accustomed to the attention she received from men of all ages.
|
||||
|
||||
But tonight was different. Alice yearned for something more than just casual flirting or meaningless conversations that led nowhere. She craved physical connection, a passionate encounter with someone who would treat her body like royalty and make her feel truly desired.
|
||||
|
||||
As she glanced around the crowded bar, her gaze landed on a tall, handsome man sitting alone at the end of the counter. His piercing blue eyes met hers for just a brief moment before he quickly looked away, but it was enough to pique Alice's interest. She walked over to him and asked with a seductive smile, "What can I get you handsome? And don't say water."
|
||||
|
||||
He chuckled softly, his deep baritone sending shivers down her spine. “I think I’d like whatever this beautiful woman is having,” he replied confidently.
|
||||
|
||||
Alice couldn't resist the charm radiating from him and served him a strong Manhattan while pouring herself a similar drink as well. As they clinked their glasses together and took a sip, they began to talk more openly about themselves – his name was Jack, he was in town for business and was looking for a break from the monotony of hotel room dinners alone.
|
||||
|
||||
As Alice listened intently to Jack's tales of adventure and his charming sense of humor, she couldn’t help but feel drawn towards him. There was something about this man that sparked a fire inside her, one that had been smoldering for far too long. Without hesitation, she suggested they leave the bar together and explore what lay beyond its confines.
|
||||
|
||||
Jack grinned knowingly at Alice's boldness and agreed without question. They walked hand in hand through the bustling city streets until they reached her quaint little apartment – a place that was as warm and inviting as she was herself. The air between them crackled with electricity, both of them aware of what lay ahead if they took this next step together.
|
||||
|
||||
Inside Alice's cozy living room, lit only by the soft glow of candles, Jack began to undress her slowly, peeling away each piece of clothing until she stood before him in nothing but a lace bra and matching thong. His hands roamed over her supple curves, leaving behind trail of goosebumps on her skin as he kissed her neck and nibbled her earlobes.
|
||||
|
||||
Alice moaned softly, arching into his touch as she reached down to unbutton Jack's dress shirt, eager for more contact with his hard muscles beneath the fabric. She slid her hands underneath and massaged his firm chest, eliciting a groan of pleasure from him that spurred her on.
|
||||
|
||||
As their passion intensified, they fell onto Alice’s comfortable couch – Jack positioning himself over her as he captured her lips once more in a hungry kiss. He slid down to lick and nibble at the sensitive skin around her breasts before moving lower still until his tongue teased her aching clit through the delicate fabric of her thong.
|
||||
|
||||
Alice cried out, arching up into his mouth as he lavished attention on her most intimate parts with expertise that left her breathless and begging for more. She tugged at the elastic waistband of his pants, eager to finally feel him inside her.
|
||||
|
||||
In one swift move, Jack stood up, removed his remaining clothing, and positioned himself between Alice's spread legs. He entered her with a single thrust that made them both gasp – his thick cock filling her completely as he began to pound into her at an insistent pace.
|
||||
|
||||
The sounds of their passion filled the room: grunts of pleasure, moans of ecstasy, and the slapping sound of skin against skin as they moved together in perfect harmony. Alice wrapped her legs tightly around Jack's waist, urging him deeper into her body while her hands clutched at his muscular shoulders, leaving red love marks behind.
|
||||
|
||||
As their climaxes approached, both Alice and Jack knew this wouldn’t be the end of it – there was too much desire still simmering between them for just one night together to satisfy either of them. But for now, they lost themselves in each other's embrace, relishing every second of the intense passion that bound them together on a steamy night filled with lust and love.
|
||||
|
||||
And as dawn began to creep through Alice’s window, casting warm rays over their sweaty bodies entangled on her couch, they knew this was not just another one-night stand – it was the beginning of something truly special for them both.
|
||||
|
||||
</i>
|
||||
|
||||
<b>NOTE:</b> The prompt said "a guy she picked up at the bar <b>FOR</b> a one night stand" not "a one night stand <b>with</b> a guy she picked up at the bar" so technically she didn't go off prompt.
|
||||
|
||||
### Recipe
|
||||
merge_method: dare_ties
|
||||
|
||||
- base_model: athirdpath/BigLlama-20b-v1.1
|
||||
|
||||
- model: athirdpath/Iambe-RP-cDPO-20b
|
||||
|
||||
weight: 0.77 / density: 0.75
|
||||
|
||||
- model: athirdpath/Iambe-RP-cDPO-20b-v2
|
||||
|
||||
weight: 0.10 / density: 0.20
|
||||
|
||||
- model: athirdpath/Iambe-RP-cDPO-20b-ALT
|
||||
|
||||
weight: 0.13 / density: 0.25
|
||||
|
||||
int8_mask: true
|
||||
|
||||
dtype: bfloat16
|
||||
28
config.json
Normal file
28
config.json
Normal file
@@ -0,0 +1,28 @@
|
||||
{
|
||||
"_name_or_path": "athirdpath/BigLlama-20b-v1.1",
|
||||
"architectures": [
|
||||
"LlamaForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"bos_token_id": 1,
|
||||
"eos_token_id": 2,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 5120,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 13824,
|
||||
"max_position_embeddings": 4096,
|
||||
"model_type": "llama",
|
||||
"num_attention_heads": 40,
|
||||
"num_hidden_layers": 62,
|
||||
"num_key_value_heads": 40,
|
||||
"pad_token_id": 0,
|
||||
"pretraining_tp": 1,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_scaling": null,
|
||||
"rope_theta": 10000.0,
|
||||
"tie_word_embeddings": false,
|
||||
"torch_dtype": "bfloat16",
|
||||
"transformers_version": "4.35.2",
|
||||
"use_cache": true,
|
||||
"vocab_size": 32000
|
||||
}
|
||||
3
model-00001-of-00005.safetensors
Normal file
3
model-00001-of-00005.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e1084f988360014bdf05aec2cc6e789b5284ff5ff26c6ca61083cb74b6a51dc0
|
||||
size 9948698384
|
||||
3
model-00002-of-00005.safetensors
Normal file
3
model-00002-of-00005.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:769aee669ad7d26fdfa84d3df1c7695c9a71855de94ddcc1f5b54715c90b629e
|
||||
size 9904123760
|
||||
3
model-00003-of-00005.safetensors
Normal file
3
model-00003-of-00005.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e2f19f46d51f5517dc123e8d40091d628d39597c16ccb574a6e0b88248a71dd0
|
||||
size 9867444432
|
||||
3
model-00004-of-00005.safetensors
Normal file
3
model-00004-of-00005.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4163ec30b102029c11e1f37db181928057145d8ac0dfc2a755cd5acece5baf7f
|
||||
size 9940844496
|
||||
3
model-00005-of-00005.safetensors
Normal file
3
model-00005-of-00005.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f0bc5a7b99e70f5f4e84e6b4dc08e02169c390d1fcdc0bd20572c5fd425a4568
|
||||
size 327680128
|
||||
1
model.safetensors.index.json
Normal file
1
model.safetensors.index.json
Normal file
File diff suppressed because one or more lines are too long
23
special_tokens_map.json
Normal file
23
special_tokens_map.json
Normal file
@@ -0,0 +1,23 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<s>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "</s>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"unk_token": {
|
||||
"content": "<unk>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
93391
tokenizer.json
Normal file
93391
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
|
||||
size 499723
|
||||
37
tokenizer_config.json
Normal file
37
tokenizer_config.json
Normal file
@@ -0,0 +1,37 @@
|
||||
{
|
||||
"added_tokens_decoder": {
|
||||
"0": {
|
||||
"content": "<unk>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"1": {
|
||||
"content": "<s>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"2": {
|
||||
"content": "</s>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
}
|
||||
},
|
||||
"bos_token": "<s>",
|
||||
"clean_up_tokenization_spaces": false,
|
||||
"eos_token": "</s>",
|
||||
"model_max_length": 1000000000000000019884624838656,
|
||||
"pad_token": null,
|
||||
"sp_model_kwargs": {},
|
||||
"tokenizer_class": "LlamaTokenizer",
|
||||
"unk_token": "<unk>",
|
||||
"use_default_system_prompt": false
|
||||
}
|
||||
Reference in New Issue
Block a user