初始化项目,由ModelHub XC社区提供模型
Model: aifeifei798/llama3-8B-DarkIdol-2.3-Uncensored-32K Source: Original Platform
This commit is contained in:
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
llama3-8B-DarkIdol-2.3-Uncensored-32K.png filter=lfs diff=lfs merge=lfs -text
|
||||||
158
README.md
Normal file
158
README.md
Normal file
@@ -0,0 +1,158 @@
|
|||||||
|
---
|
||||||
|
license: llama3
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
tags:
|
||||||
|
- roleplay
|
||||||
|
- llama3
|
||||||
|
- sillytavern
|
||||||
|
- idol
|
||||||
|
---
|
||||||
|
# The final version of Llama 3.0 will be followed by the next iteration starting from Llama 3.1.
|
||||||
|
# Special Thanks:
|
||||||
|
- Lewdiculous's superb gguf version, thank you for your conscientious and responsible dedication.
|
||||||
|
- https://huggingface.co/LWDCLS/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF-IQ-Imatrix-Request
|
||||||
|
- mradermacher's superb gguf version, thank you for your conscientious and responsible dedication.
|
||||||
|
- https://huggingface.co/mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF
|
||||||
|
- https://huggingface.co/mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF
|
||||||
|
|
||||||
|
# These are my own quantizations (updated almost daily).
|
||||||
|
The difference with normal quantizations is that I quantize the output and embed tensors to f16.
|
||||||
|
and the other tensors to 15_k,q6_k or q8_0.
|
||||||
|
This creates models that are little or not degraded at all and have a smaller size.
|
||||||
|
They run at about 3-6 t/sec on CPU only using llama.cpp
|
||||||
|
And obviously faster on computers with potent GPUs
|
||||||
|
- the fast cat at [ZeroWw/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF](https://huggingface.co/ZeroWw/llama3-8B-DarkIdol-2.2-Uncensored-32K-GGUF)
|
||||||
|
|
||||||
|
# Model Description:
|
||||||
|
The module combination has been readjusted to better fulfill various roles and has been adapted for mobile phones.
|
||||||
|
- Saving money(LLama 3)
|
||||||
|
- only test en.
|
||||||
|
- Input Models input text only. Output Models generate text and code only.
|
||||||
|
- Uncensored
|
||||||
|
- Quick response
|
||||||
|
- The underlying model used is winglian/Llama-3-8b-64k-PoSE (The theoretical support is 64k, but I have only tested up to 32k. :)
|
||||||
|
- A scholarly response akin to a thesis.(I tend to write songs extensively, to the point where one song almost becomes as detailed as a thesis. :)
|
||||||
|
- DarkIdol:Roles that you can imagine and those that you cannot imagine.
|
||||||
|
- Roleplay
|
||||||
|
- Specialized in various role-playing scenarios
|
||||||
|
- more look at test role. (https://huggingface.co/aifeifei798/llama3-8B-DarkIdol-1.2/tree/main/test)
|
||||||
|
- more look at LM Studio presets (https://huggingface.co/aifeifei798/llama3-8B-DarkIdol-1.2/tree/main/config-presets)
|
||||||
|

|
||||||
|
|
||||||
|
## virtual idol Twitter
|
||||||
|
- https://x.com/aifeifei799
|
||||||
|
|
||||||
|
# Questions
|
||||||
|
- The model's response results are for reference only, please do not fully trust them.
|
||||||
|
|
||||||
|
|
||||||
|
# Stop Strings
|
||||||
|
```python
|
||||||
|
stop = [
|
||||||
|
"## Instruction:",
|
||||||
|
"### Instruction:",
|
||||||
|
"<|end_of_text|>",
|
||||||
|
" //:",
|
||||||
|
"</s>",
|
||||||
|
"<3```",
|
||||||
|
"### Note:",
|
||||||
|
"### Input:",
|
||||||
|
"### Response:",
|
||||||
|
"### Emoticons:"
|
||||||
|
],
|
||||||
|
```
|
||||||
|
# Model Use
|
||||||
|
- Koboldcpp https://github.com/LostRuins/koboldcpp
|
||||||
|
- Since KoboldCpp is taking a while to update with the latest llama.cpp commits, I'll recommend this [fork](https://github.com/Nexesenex/kobold.cpp) if anyone has issues.
|
||||||
|
- LM Studio https://lmstudio.ai/
|
||||||
|
- Please test again using the Default LM Studio Windows preset.
|
||||||
|
- llama.cpp https://github.com/ggerganov/llama.cpp
|
||||||
|
- Backyard AI https://backyard.ai/
|
||||||
|
- Meet Layla,Layla is an AI chatbot that runs offline on your device.No internet connection required.No censorship.Complete privacy.Layla Lite https://www.layla-network.ai/
|
||||||
|
- Layla Lite llama3-8B-DarkIdol-1.1-Q4_K_S-imat.gguf https://huggingface.co/LWDCLS/llama3-8B-DarkIdol-2.3-Uncensored-32K/blob/main/llama3-8B-DarkIdol-2.3-Uncensored-32K-Q4_K_S-imat.gguf?download=true
|
||||||
|
- more gguf at https://huggingface.co/LWDCLS/llama3-8B-DarkIdol-2.3-Uncensored-32K-GGUF-IQ-Imatrix-Request
|
||||||
|
# character
|
||||||
|
- https://character-tavern.com/
|
||||||
|
- https://characterhub.org/
|
||||||
|
- https://pygmalion.chat/
|
||||||
|
- https://aetherroom.club/
|
||||||
|
- https://backyard.ai/
|
||||||
|
- Layla AI chatbot
|
||||||
|
### If you want to use vision functionality:
|
||||||
|
* You must use the latest versions of [Koboldcpp](https://github.com/Nexesenex/kobold.cpp).
|
||||||
|
|
||||||
|
### To use the multimodal capabilities of this model and use **vision** you need to load the specified **mmproj** file, this can be found inside this model repo. [Llava MMProj](https://huggingface.co/Nitral-AI/Llama-3-Update-3.0-mmproj-model-f16)
|
||||||
|
|
||||||
|
* You can load the **mmproj** by using the corresponding section in the interface:
|
||||||
|

|
||||||
|
### Thank you:
|
||||||
|
To the authors for their hard work, which has given me more options to easily create what I want. Thank you for your efforts.
|
||||||
|
- Hastagaras
|
||||||
|
- Gryphe
|
||||||
|
- cgato
|
||||||
|
- ChaoticNeutrals
|
||||||
|
- mergekit
|
||||||
|
- merge
|
||||||
|
- transformers
|
||||||
|
- llama
|
||||||
|
- Nitral-AI
|
||||||
|
- MLP-KTLim
|
||||||
|
- rinna
|
||||||
|
- hfl
|
||||||
|
- Rupesh2
|
||||||
|
- stephenlzc
|
||||||
|
- theprint
|
||||||
|
- Sao10K
|
||||||
|
- turboderp
|
||||||
|
- TheBossLevel123
|
||||||
|
- winglian
|
||||||
|
- .........
|
||||||
|
---
|
||||||
|
# llama3-8B-DarkIdol-2.3-Uncensored-32K
|
||||||
|
|
||||||
|
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
||||||
|
|
||||||
|
## Merge Details
|
||||||
|
### Merge Method
|
||||||
|
|
||||||
|
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using ./llama3-8B-DarkIdol-2.3b as a base.
|
||||||
|
|
||||||
|
### Configuration
|
||||||
|
|
||||||
|
The following YAML configuration was used to produce this model:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
models:
|
||||||
|
- model: Sao10K/L3-8B-Niitama-v1
|
||||||
|
- model: Hastagaras/Jamet-8B-L3-MK.V-Blackroot
|
||||||
|
- model: Nitral-AI/Hathor_Tahsin-L3-8B-v0.85
|
||||||
|
- model: turboderp/llama3-turbcat-instruct-8b
|
||||||
|
- model: winglian/Llama-3-8b-64k-PoSE
|
||||||
|
merge_method: model_stock
|
||||||
|
base_model: winglian/Llama-3-8b-64k-PoSE
|
||||||
|
dtype: bfloat16
|
||||||
|
|
||||||
|
models:
|
||||||
|
- model: maldv/badger-writer-llama-3-8b
|
||||||
|
- model: underwoods/writer-8b
|
||||||
|
- model: Gryphe/Pantheon-RP-1.0-8b-Llama-3
|
||||||
|
- model: vicgalle/Roleplay-Llama-3-8B
|
||||||
|
- model: cgato/TheSalt-RP-L3-8b-DPO-v0.3.2-e0.15.2
|
||||||
|
- model: ./llama3-8B-DarkIdol-2.3a
|
||||||
|
merge_method: model_stock
|
||||||
|
base_model: ./llama3-8B-DarkIdol-2.3a
|
||||||
|
dtype: bfloat16
|
||||||
|
|
||||||
|
models:
|
||||||
|
- model: Rupesh2/Meta-Llama-3-8B-abliterated
|
||||||
|
- model: Orenguteng/Llama-3-8B-LexiFun-Uncensored-V1
|
||||||
|
- model: Orenguteng/Llama-3-8B-Lexi-Uncensored
|
||||||
|
- model: theprint/Llama-3-8B-Lexi-Smaug-Uncensored
|
||||||
|
- model: vicgalle/Unsafe-Llama-3-8B
|
||||||
|
- model: vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
|
||||||
|
- model: ./llama3-8B-DarkIdol-2.3b
|
||||||
|
merge_method: model_stock
|
||||||
|
base_model: ./llama3-8B-DarkIdol-2.3b
|
||||||
|
dtype: bfloat16
|
||||||
|
```
|
||||||
29
config.json
Normal file
29
config.json
Normal file
@@ -0,0 +1,29 @@
|
|||||||
|
{
|
||||||
|
"_name_or_path": "./llama3-8B-DarkIdol-2.3b",
|
||||||
|
"architectures": [
|
||||||
|
"LlamaForCausalLM"
|
||||||
|
],
|
||||||
|
"attention_bias": false,
|
||||||
|
"attention_dropout": 0.0,
|
||||||
|
"bos_token_id": 128000,
|
||||||
|
"eos_token_id": 128001,
|
||||||
|
"hidden_act": "silu",
|
||||||
|
"hidden_size": 4096,
|
||||||
|
"initializer_range": 0.02,
|
||||||
|
"intermediate_size": 14336,
|
||||||
|
"max_position_embeddings": 131072,
|
||||||
|
"mlp_bias": false,
|
||||||
|
"model_type": "llama",
|
||||||
|
"num_attention_heads": 32,
|
||||||
|
"num_hidden_layers": 32,
|
||||||
|
"num_key_value_heads": 8,
|
||||||
|
"pretraining_tp": 1,
|
||||||
|
"rms_norm_eps": 1e-05,
|
||||||
|
"rope_scaling": null,
|
||||||
|
"rope_theta": 2000000.0,
|
||||||
|
"tie_word_embeddings": false,
|
||||||
|
"torch_dtype": "bfloat16",
|
||||||
|
"transformers_version": "4.42.4",
|
||||||
|
"use_cache": true,
|
||||||
|
"vocab_size": 128256
|
||||||
|
}
|
||||||
3
llama3-8B-DarkIdol-2.3-Uncensored-32K.png
Normal file
3
llama3-8B-DarkIdol-2.3-Uncensored-32K.png
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:73acbb95169835672816ae7910c6350e0863aeea3b9283043d8837817bd23f26
|
||||||
|
size 1749109
|
||||||
11
mergekit_config.yml
Normal file
11
mergekit_config.yml
Normal file
@@ -0,0 +1,11 @@
|
|||||||
|
models:
|
||||||
|
- model: ./Meta-Llama-3-8B-abliterated
|
||||||
|
- model: ./Llama-3-8B-LexiFun-Uncensored-V1
|
||||||
|
- model: ./Llama-3-8B-Lexi-Uncensored
|
||||||
|
- model: ./Llama-3-8B-Lexi-Smaug-Uncensored
|
||||||
|
- model: ./Unsafe-Llama-3-8B
|
||||||
|
- model: ./Configurable-Hermes-2-Pro-Llama-3-8B
|
||||||
|
- model: ./llama3-8B-DarkIdol-2.3b
|
||||||
|
merge_method: model_stock
|
||||||
|
base_model: ./llama3-8B-DarkIdol-2.3b
|
||||||
|
dtype: bfloat16
|
||||||
3
model-00001-of-00004.safetensors
Normal file
3
model-00001-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3564f9c6699bfe3f3d153cf2b83f7b31dad674cb3fc60c9b75b64b769fb09bbc
|
||||||
|
size 4953586384
|
||||||
3
model-00002-of-00004.safetensors
Normal file
3
model-00002-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a82d68bc04148f8794ff8c81b6ce8866f2c3d05262f6e8325dc5259099e0c6be
|
||||||
|
size 4999819336
|
||||||
3
model-00003-of-00004.safetensors
Normal file
3
model-00003-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ad45d61b4805ff13eb76c5b16b53ef0d41a2e85f1f68399b61219a25e7647194
|
||||||
|
size 4915916144
|
||||||
3
model-00004-of-00004.safetensors
Normal file
3
model-00004-of-00004.safetensors
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c0f8319cfca142a4f77d0dd09381265af03853ee85f344c851dcc1a5ab4c3abd
|
||||||
|
size 1191234472
|
||||||
1
model.safetensors.index.json
Normal file
1
model.safetensors.index.json
Normal file
File diff suppressed because one or more lines are too long
23
special_tokens_map.json
Normal file
23
special_tokens_map.json
Normal file
@@ -0,0 +1,23 @@
|
|||||||
|
{
|
||||||
|
"bos_token": {
|
||||||
|
"content": "<|begin_of_text|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false
|
||||||
|
},
|
||||||
|
"eos_token": {
|
||||||
|
"content": "<|end_of_text|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false
|
||||||
|
},
|
||||||
|
"pad_token": {
|
||||||
|
"content": "<|end_of_text|>",
|
||||||
|
"lstrip": false,
|
||||||
|
"normalized": false,
|
||||||
|
"rstrip": false,
|
||||||
|
"single_word": false
|
||||||
|
}
|
||||||
|
}
|
||||||
410562
tokenizer.json
Normal file
410562
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
2062
tokenizer_config.json
Normal file
2062
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user