初始化项目,由ModelHub XC社区提供模型
Model: Epiculous/Azure_Dusk-v0.2-GGUF Source: Original Platform
This commit is contained in:
55
.gitattributes
vendored
Normal file
55
.gitattributes
vendored
Normal file
@@ -0,0 +1,55 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_f32.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Azure_Dusk-v0.2_imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Azure_Dusk-v0.2_IQ1_S.gguf
Normal file
3
Azure_Dusk-v0.2_IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9c20f7c1210be3b822f44e867d8fc16ed9220d8805d6f239b39b8f3fa909803c
|
||||||
|
size 2999211104
|
||||||
3
Azure_Dusk-v0.2_IQ2_XS.gguf
Normal file
3
Azure_Dusk-v0.2_IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4427615df8404731265953497917fe517109853ffdd93355bdfbcd4dec16463e
|
||||||
|
size 3915076704
|
||||||
3
Azure_Dusk-v0.2_IQ2_XXS.gguf
Normal file
3
Azure_Dusk-v0.2_IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b5c323e6b26e9a3ba78532e42327240d294aac15b4218ab5378036bf2c14742d
|
||||||
|
size 3592311904
|
||||||
3
Azure_Dusk-v0.2_IQ3_XS.gguf
Normal file
3
Azure_Dusk-v0.2_IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0dbee9616ee41cd3db3c9a0cee9de73675fd067e3bf4bfdc6b718fd8a7a60c99
|
||||||
|
size 5306487904
|
||||||
3
Azure_Dusk-v0.2_IQ3_XXS.gguf
Normal file
3
Azure_Dusk-v0.2_IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7f3a72f77cf96384c0d6d802b1d82cc06b28acc9b4c6aa1ecc6fb8e9f21124d4
|
||||||
|
size 4945384544
|
||||||
3
Azure_Dusk-v0.2_IQ4_NL.gguf
Normal file
3
Azure_Dusk-v0.2_IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2dd5a43eb4d17f43ee4e71cad3e3e8bed814e2f200f8cc068b295af53992a5fa
|
||||||
|
size 7097914464
|
||||||
3
Azure_Dusk-v0.2_Q3_K_L.gguf
Normal file
3
Azure_Dusk-v0.2_Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:58add68a7812ce5f02f9f480b6b81ece27e83b84c72b4d85c7e468dadbfc2d50
|
||||||
|
size 6561502304
|
||||||
3
Azure_Dusk-v0.2_Q3_K_M.gguf
Normal file
3
Azure_Dusk-v0.2_Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:5ae750edce0db715cdc7c714f5c537b0bbc2177416f8397ad9067b7c243dc2c0
|
||||||
|
size 6083089504
|
||||||
3
Azure_Dusk-v0.2_Q3_K_S.gguf
Normal file
3
Azure_Dusk-v0.2_Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:82c2b651692aa0eb525d5cb195501a66497e0b8207addfc3116e5aead856c3cc
|
||||||
|
size 5534225504
|
||||||
3
Azure_Dusk-v0.2_Q4_K_M.gguf
Normal file
3
Azure_Dusk-v0.2_Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:404cd31cb438f1913501c2156c5a49cd9870c320905bb957d2a31a558f30b0f9
|
||||||
|
size 7477204064
|
||||||
3
Azure_Dusk-v0.2_Q4_K_S.gguf
Normal file
3
Azure_Dusk-v0.2_Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:651a851189abf6918fb43c927c11d81904d625a78dec6de4b3e2b9d9851b7116
|
||||||
|
size 7120196704
|
||||||
3
Azure_Dusk-v0.2_Q5_1.gguf
Normal file
3
Azure_Dusk-v0.2_Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a045b13d5c25280d25aeef273cb18d2fb11b23fed03256d1eab6322d36f5a59a
|
||||||
|
size 9242252384
|
||||||
3
Azure_Dusk-v0.2_Q5_K_M.gguf
Normal file
3
Azure_Dusk-v0.2_Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1649ffef9daa2c171f87f570fd947792bb75ac5263a5199a02d1d72309ff3619
|
||||||
|
size 8727630944
|
||||||
3
Azure_Dusk-v0.2_Q5_K_S.gguf
Normal file
3
Azure_Dusk-v0.2_Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:29388f868b675c3be39ece99bb0253eefe727b5d21e55d4034cac3404e3fe4f5
|
||||||
|
size 8518734944
|
||||||
3
Azure_Dusk-v0.2_Q6_K.gguf
Normal file
3
Azure_Dusk-v0.2_Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d99203ac897fa49ffa46504aedb2e30559401cddd11679da3c5d0e5977d034a2
|
||||||
|
size 10056209504
|
||||||
3
Azure_Dusk-v0.2_Q8_0.gguf
Normal file
3
Azure_Dusk-v0.2_Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6a0bfda7afdf90edfbe642deb8ae7537ffaa3e3e8a073cb335ab94db5b89222b
|
||||||
|
size 13022368864
|
||||||
3
Azure_Dusk-v0.2_bf16.gguf
Normal file
3
Azure_Dusk-v0.2_bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:365295064d0ebe33238ca3398917b1eddb35e0baa8879e4daff4e184fcc9ec96
|
||||||
|
size 24504275840
|
||||||
3
Azure_Dusk-v0.2_f16.gguf
Normal file
3
Azure_Dusk-v0.2_f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b1ae3f2ad1662249e3b6a774f973cb913612a7c9116eed9c72c1e3f01bd34545
|
||||||
|
size 24504275840
|
||||||
3
Azure_Dusk-v0.2_f32.gguf
Normal file
3
Azure_Dusk-v0.2_f32.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2601661783b9b2ce39a2367202008713a9a3786a9da9f4c887976bb61b2de77e
|
||||||
|
size 48999011200
|
||||||
3
Azure_Dusk-v0.2_imatrix.dat
Normal file
3
Azure_Dusk-v0.2_imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:19cfa2ef624445c16fd546c8df5998666be2bf427b133bcc2b1d72d7e2dc09ed
|
||||||
|
size 7054399
|
||||||
54
README.md
Normal file
54
README.md
Normal file
@@ -0,0 +1,54 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
datasets:
|
||||||
|
- Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/stheno-filtered-v1.1
|
||||||
|
- PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT
|
||||||
|
- Gryphe/Sonnet3.5-Charcard-Roleplay
|
||||||
|
- Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/kalo-opus-instruct-22k-no-refusal
|
||||||
|
- anthracite-org/nopm_claude_writing_fixed
|
||||||
|
- anthracite-org/kalo_opus_misc_240827
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- fr
|
||||||
|
- de
|
||||||
|
- es
|
||||||
|
- it
|
||||||
|
- pt
|
||||||
|
- ru
|
||||||
|
- zh
|
||||||
|
- ja
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
---
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
Following up on Crimson_Dawn-v0.2 we have Azure_Dusk-v0.2! Training on [Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407) this time I've added significantly more data, as well as trained using RSLoRA as opposed to regular LoRA. Another key change is training on ChatML as opposed to Mistral Formatting.
|
||||||
|
|
||||||
|
[full](https://huggingface.co/Epiculous/Azure_Dusk-v0.2) / [exl2](https://huggingface.co/Epiculous/Azure_Dusk-v0.2-exl2) / <strong>gguf</strong>
|
||||||
|
|
||||||
|
## Prompting
|
||||||
|
The v0.2 models are trained on ChatML, the prompting structure goes a little something like this:
|
||||||
|
|
||||||
|
```
|
||||||
|
<|im_start|>user
|
||||||
|
Hi there!<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
Nice to meet you!<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
Can I ask a question?<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
### Context and Instruct
|
||||||
|
The v0.2 models are trained on ChatML, please use that Context and Instruct template.
|
||||||
|
|
||||||
|
### Current Top Sampler Settings
|
||||||
|
[Spicy_Temp](https://files.catbox.moe/9npj0z.json) <br/>
|
||||||
|
[Violet_Twilight-Nitral-Special](https://files.catbox.moe/ot54u3.json) <br/>
|
||||||
|
|
||||||
|
## Training
|
||||||
|
Training was done twice over 2 epochs each on two 2x [NVIDIA A6000 GPUs](https://www.nvidia.com/en-us/design-visualization/rtx-a6000/) using LoRA. A two-phased approach was used in which the base model was trained 2 epochs on RP data, the LoRA was then applied to base. Finally, the new modified base was trained 2 epochs on instruct, and the new instruct LoRA was applied to the modified base, resulting in what you see here.
|
||||||
|
|
||||||
|
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
||||||
Reference in New Issue
Block a user