初始化项目,由ModelHub XC社区提供模型
Model: Epiculous/Violet_Twilight-v0.2-GGUF Source: Original Platform
This commit is contained in:
56
.gitattributes
vendored
Normal file
56
.gitattributes
vendored
Normal file
@@ -0,0 +1,56 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.f32.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Violet_Twilight-v0.2.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
76
README.md
Normal file
76
README.md
Normal file
@@ -0,0 +1,76 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
datasets:
|
||||||
|
- Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/stheno-filtered-v1.1
|
||||||
|
- PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT
|
||||||
|
- Gryphe/Sonnet3.5-Charcard-Roleplay
|
||||||
|
- Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/kalo-opus-instruct-22k-no-refusal
|
||||||
|
- anthracite-org/nopm_claude_writing_fixed
|
||||||
|
- anthracite-org/kalo_opus_misc_240827
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- fr
|
||||||
|
- de
|
||||||
|
- es
|
||||||
|
- it
|
||||||
|
- pt
|
||||||
|
- ru
|
||||||
|
- zh
|
||||||
|
- ja
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- merge
|
||||||
|
---
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
Now for something a bit different, Violet_Twilight-v0.2! This model is a SLERP merge of Azure_Dusk-v0.2 and Crimson_Dawn-v0.2!
|
||||||
|
|
||||||
|
# Quants!
|
||||||
|
[full](https://huggingface.co/Epiculous/Violet_Twilight-v0.2) / [exl2](https://huggingface.co/Epiculous/Violet_Twilight-v0.2-exl2) / <strong>gguf</strong>
|
||||||
|
|
||||||
|
## Prompting
|
||||||
|
The v0.2 models are trained on ChatML, the prompting structure goes a little something like this:
|
||||||
|
|
||||||
|
```
|
||||||
|
<|im_start|>user
|
||||||
|
Hi there!<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
Nice to meet you!<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
Can I ask a question?<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
### Context and Instruct
|
||||||
|
The v0.2 models are trained on ChatML, please use that Context and Instruct template.
|
||||||
|
|
||||||
|
### Current Top Sampler Settings
|
||||||
|
[Smooth Creativity](https://files.catbox.moe/0ihfir.json): Credit to Juelsman for researching this one!<br/>
|
||||||
|
[Variant Chimera](https://files.catbox.moe/h7vd45.json): Credit to Numbra!<br/>
|
||||||
|
[Spicy_Temp](https://files.catbox.moe/9npj0z.json) <br/>
|
||||||
|
[Violet_Twilight-Nitral-Special](https://files.catbox.moe/ot54u3.json) <br/>
|
||||||
|
|
||||||
|
## Merging
|
||||||
|
The following config was used to merge Azure Dusk and Crimson Dawn
|
||||||
|
```yaml
|
||||||
|
slices:
|
||||||
|
- sources:
|
||||||
|
- model: Epiculous/Azure_Dusk-v0.2
|
||||||
|
layer_range: [0, 40]
|
||||||
|
- model: Epiculous/Crimson_Dawn-V0.2
|
||||||
|
layer_range: [0, 40]
|
||||||
|
merge_method: slerp
|
||||||
|
base_model: Epiculous/Azure_Dusk-v0.2
|
||||||
|
parameters:
|
||||||
|
t:
|
||||||
|
- filter: self_attn
|
||||||
|
value: [0, 0.5, 0.3, 0.7, 1]
|
||||||
|
- filter: mlp
|
||||||
|
value: [1, 0.5, 0.7, 0.3, 0]
|
||||||
|
- value: 0.5 # fallback for rest of tensors
|
||||||
|
dtype: bfloat16
|
||||||
|
|
||||||
|
```
|
||||||
3
Violet_Twilight-v0.2.IQ1_S.gguf
Normal file
3
Violet_Twilight-v0.2.IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bd15e5b9f596e764c8381fcf255dda006bb0add8e93b65a9a12fa7ce58a86a91
|
||||||
|
size 2999211712
|
||||||
3
Violet_Twilight-v0.2.IQ2_XS.gguf
Normal file
3
Violet_Twilight-v0.2.IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b00ea13aa08d65dff4cfbbc69fe744faec03ae44268d796434e68f63cc3bba71
|
||||||
|
size 3915077312
|
||||||
3
Violet_Twilight-v0.2.IQ2_XXS.gguf
Normal file
3
Violet_Twilight-v0.2.IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ec2b07d559b045bfcc33c5a95fd4bdbdcba96b6fa69585541d60c8dcf6bb3976
|
||||||
|
size 3592312512
|
||||||
3
Violet_Twilight-v0.2.IQ3_XS.gguf
Normal file
3
Violet_Twilight-v0.2.IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2bb266e864dde2e4cda663affdee55d2d6dbff873773ddbf4a1cb3473142beec
|
||||||
|
size 5306488512
|
||||||
3
Violet_Twilight-v0.2.IQ3_XXS.gguf
Normal file
3
Violet_Twilight-v0.2.IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:73f4c574cebadd9ae467291ace7892d9e6f05bde3d8c49a3ccc49b73232107f4
|
||||||
|
size 4945385152
|
||||||
3
Violet_Twilight-v0.2.IQ4_NL.gguf
Normal file
3
Violet_Twilight-v0.2.IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7da3ab1156472141214b67fae599906306b5501205549293214ab2df4c759b6c
|
||||||
|
size 7097915072
|
||||||
3
Violet_Twilight-v0.2.IQ4_XS.gguf
Normal file
3
Violet_Twilight-v0.2.IQ4_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9c61131b46025975e2cbee34c7251e43c2b8968119c98d72a5cc407b81c420cf
|
||||||
|
size 6742709952
|
||||||
3
Violet_Twilight-v0.2.Q3_K_L.gguf
Normal file
3
Violet_Twilight-v0.2.Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1019f9d5be096c1dd75863d8060587d6b61347c1695c0602d46c102d1e8daea0
|
||||||
|
size 6561502912
|
||||||
3
Violet_Twilight-v0.2.Q3_K_M.gguf
Normal file
3
Violet_Twilight-v0.2.Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5cecd2beb15e20fe74b25734d7ea356ad3d006076eceb521bfe44a57c2362843
|
||||||
|
size 6083090112
|
||||||
3
Violet_Twilight-v0.2.Q3_K_S.gguf
Normal file
3
Violet_Twilight-v0.2.Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6812ba2de43d27e56e51b2393a1ec5e66caa76a2c5cfafcad4d60cd1f9a70d58
|
||||||
|
size 5534226112
|
||||||
3
Violet_Twilight-v0.2.Q4_K_M.gguf
Normal file
3
Violet_Twilight-v0.2.Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b63f07cc441146af9c98cd3c3d4390d7c39bfef11c1d168dc7c6244ca2ba6b12
|
||||||
|
size 7477204672
|
||||||
3
Violet_Twilight-v0.2.Q4_K_S.gguf
Normal file
3
Violet_Twilight-v0.2.Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4df5f27c2adba6cccb3a2ca45dba706688bf198a19604383bca6a16b88e2b365
|
||||||
|
size 7120197312
|
||||||
3
Violet_Twilight-v0.2.Q5_1.gguf
Normal file
3
Violet_Twilight-v0.2.Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4a65ff91f4c35e9d13cc4dfd5280cbb4a879290ba273518ebef78e80b69271fe
|
||||||
|
size 9242252992
|
||||||
3
Violet_Twilight-v0.2.Q5_K_M.gguf
Normal file
3
Violet_Twilight-v0.2.Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7230d6b5b3c33c3290d99450e7962e001a231ccb609222fc4ca549c87d9ba2ef
|
||||||
|
size 8727631552
|
||||||
3
Violet_Twilight-v0.2.Q5_K_S.gguf
Normal file
3
Violet_Twilight-v0.2.Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:05714c681562cfbf5d8eb18a31bc87d48cd1fa1aea8c20d64a2455f96d38f56c
|
||||||
|
size 8518735552
|
||||||
3
Violet_Twilight-v0.2.Q6_K.gguf
Normal file
3
Violet_Twilight-v0.2.Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:297a20a336604b3dda02fb4f4c34ddc588f651ea0dab03be3b5711f4517abd0b
|
||||||
|
size 10056210112
|
||||||
3
Violet_Twilight-v0.2.Q8_0.gguf
Normal file
3
Violet_Twilight-v0.2.Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:871187f4bfa7c757539c153b32c7e28733f82bef2430eb3cfff12f8bd5a7f95a
|
||||||
|
size 13022369472
|
||||||
3
Violet_Twilight-v0.2.bf16.gguf
Normal file
3
Violet_Twilight-v0.2.bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d6f06b4680c9076d58c0c23fad897a65137ce53841ac0b8d77b9796e57cfffa4
|
||||||
|
size 24504276416
|
||||||
3
Violet_Twilight-v0.2.f16.gguf
Normal file
3
Violet_Twilight-v0.2.f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9ec0cccb8c7c510fd165273e614f306df8be719ca0a20e15b3da84dadfca9586
|
||||||
|
size 24504276416
|
||||||
3
Violet_Twilight-v0.2.f32.gguf
Normal file
3
Violet_Twilight-v0.2.f32.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d35c501141179b510634edb4aa7b378be007c33af5e55c5205b94341d9afadf1
|
||||||
|
size 48999011776
|
||||||
3
Violet_Twilight-v0.2.imatrix.dat
Normal file
3
Violet_Twilight-v0.2.imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f7b770d535d7b771ba0099279b58a8038249dcee22c1fdc0c3840fc60b30eecc
|
||||||
|
size 7054399
|
||||||
Reference in New Issue
Block a user