初始化项目,由ModelHub XC社区提供模型
Model: Epiculous/Crimson_Dawn-v0.2-GGUF Source: Original Platform
This commit is contained in:
55
.gitattributes
vendored
Normal file
55
.gitattributes
vendored
Normal file
@@ -0,0 +1,55 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_f32.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Crimson_Dawn-v0.2_imatrix.dat filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Crimson_Dawn-v0.2_IQ1_S.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ1_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:db7359e8a2ba81928aa77016725573e1ca39f635366e06ca13a936113519636d
|
||||||
|
size 2999211040
|
||||||
3
Crimson_Dawn-v0.2_IQ2_XS.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ2_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:77ece05052b1ebeeba647494b6b4e9af082db01730a2945deb0b904a9340acc3
|
||||||
|
size 3915076640
|
||||||
3
Crimson_Dawn-v0.2_IQ2_XXS.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ2_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e7ee06748a8979efd19067a06f410b2449a4cbd9f04763032a225e4d0e930da4
|
||||||
|
size 3592311840
|
||||||
3
Crimson_Dawn-v0.2_IQ3_XS.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ3_XS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4b7f77dd1e99964ed1c12d134ca86e8814170acc2a3aba4dbad28e2d11e5a656
|
||||||
|
size 5306487840
|
||||||
3
Crimson_Dawn-v0.2_IQ3_XXS.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ3_XXS.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a2d6370b28b1e150f9d25f2e0c194db5d5a5ed327b54d8e92e37b594ad7ccd7c
|
||||||
|
size 4945384480
|
||||||
3
Crimson_Dawn-v0.2_IQ4_NL.gguf
Normal file
3
Crimson_Dawn-v0.2_IQ4_NL.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:0b52db57a2b953c9ba70bd747a1aa2966c05a33062d618c33df5d491659f5d1f
|
||||||
|
size 7097914400
|
||||||
3
Crimson_Dawn-v0.2_Q3_K_L.gguf
Normal file
3
Crimson_Dawn-v0.2_Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:631174f808f61ddd380751bf13b754ddcd0a091614cc8715e56207bf3576f45b
|
||||||
|
size 6561502240
|
||||||
3
Crimson_Dawn-v0.2_Q3_K_M.gguf
Normal file
3
Crimson_Dawn-v0.2_Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d28da5bfe807bdaae8304fc639baf0fc0bb6a6f737a0cb26a87b539a2fcf3e71
|
||||||
|
size 6083089440
|
||||||
3
Crimson_Dawn-v0.2_Q3_K_S.gguf
Normal file
3
Crimson_Dawn-v0.2_Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:13e2abcc6673c70efcb2e3e6df94e6cc0566d41dff656d641bff9f51b406d78f
|
||||||
|
size 5534225440
|
||||||
3
Crimson_Dawn-v0.2_Q4_K_M.gguf
Normal file
3
Crimson_Dawn-v0.2_Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:d1e0c7438451e1ac3daaacc294fbe4c7641579b773a6e9944a7690f6be54af20
|
||||||
|
size 7477204000
|
||||||
3
Crimson_Dawn-v0.2_Q4_K_S.gguf
Normal file
3
Crimson_Dawn-v0.2_Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:bf46e83fa62c87a27bec54185931e984a4f0a283d452bb42bb6ca0eed6ec953b
|
||||||
|
size 7120196640
|
||||||
3
Crimson_Dawn-v0.2_Q5_1.gguf
Normal file
3
Crimson_Dawn-v0.2_Q5_1.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:feb23015da72b218327101f6a65aa33684a6ab62d124f14a77d541161d79d52a
|
||||||
|
size 9242252320
|
||||||
3
Crimson_Dawn-v0.2_Q5_K_M.gguf
Normal file
3
Crimson_Dawn-v0.2_Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c4dd34b7139d686277fb645f4ffbfd87b029a570a6688758690e1f5ce1a953d6
|
||||||
|
size 8727630880
|
||||||
3
Crimson_Dawn-v0.2_Q5_K_S.gguf
Normal file
3
Crimson_Dawn-v0.2_Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6543e4e0c258adb5a168c8063586ed131467906170f175cc1f864649f682332c
|
||||||
|
size 8518734880
|
||||||
3
Crimson_Dawn-v0.2_Q6_K.gguf
Normal file
3
Crimson_Dawn-v0.2_Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:76162c45180af6a64bef5e465bc1da0e09a321ee4b6e373955819d64beb7062d
|
||||||
|
size 10056209440
|
||||||
3
Crimson_Dawn-v0.2_Q8_0.gguf
Normal file
3
Crimson_Dawn-v0.2_Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f7a58d38462f9e3ec7cf4241cc645992953257ed501ca4a4dd46c14d07f8ae80
|
||||||
|
size 13022368800
|
||||||
3
Crimson_Dawn-v0.2_bf16.gguf
Normal file
3
Crimson_Dawn-v0.2_bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6d1d260d9351153808ae05e03665e0caa44f3ac9e3d5e6f0ca132233d22c856f
|
||||||
|
size 24504275776
|
||||||
3
Crimson_Dawn-v0.2_f16.gguf
Normal file
3
Crimson_Dawn-v0.2_f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8d115572ef67b9be1d04099ca9a8067fbd5b63c46b15360d453cc2a56950d34d
|
||||||
|
size 24504275776
|
||||||
3
Crimson_Dawn-v0.2_f32.gguf
Normal file
3
Crimson_Dawn-v0.2_f32.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b3cb67537b300581ba13765e095bfac3f599c0011f34b91bb8a3e1e4982b00b7
|
||||||
|
size 48999011136
|
||||||
3
Crimson_Dawn-v0.2_imatrix.dat
Normal file
3
Crimson_Dawn-v0.2_imatrix.dat
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:c4b1e8a7b2382cbb6ac604999c577cbf69997ec1a78977d0d6baf7dda4666ff7
|
||||||
|
size 7054399
|
||||||
55
README.md
Normal file
55
README.md
Normal file
@@ -0,0 +1,55 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
datasets:
|
||||||
|
- Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/stheno-filtered-v1.1
|
||||||
|
- PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT
|
||||||
|
- Gryphe/Sonnet3.5-Charcard-Roleplay
|
||||||
|
- Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned
|
||||||
|
- anthracite-org/kalo-opus-instruct-22k-no-refusal
|
||||||
|
- anthracite-org/nopm_claude_writing_fixed
|
||||||
|
- anthracite-org/kalo_opus_misc_240827
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- fr
|
||||||
|
- de
|
||||||
|
- es
|
||||||
|
- it
|
||||||
|
- pt
|
||||||
|
- ru
|
||||||
|
- zh
|
||||||
|
- ja
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
---
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
Taking what seemed to work out well with Crimson_Dawn-v0.1, the new Crimson_Dawn-v0.2 is the same training methodology, training on [Mistral-Nemo-Base-2407](https://huggingface.co/mistralai/Mistral-Nemo-Base-2407) this time I've added significantly more data, as well as trained using RSLoRA as opposed to regular LoRA. Another key change is training on ChatML as opposed to Mistral Formatting.
|
||||||
|
|
||||||
|
# Quants!
|
||||||
|
[full](https://huggingface.co/Epiculous/Crimson_Dawn-v0.2) / [exl2](https://huggingface.co/Epiculous/Crimson_Dawn-v0.2-exl2) / <strong>gguf</strong>
|
||||||
|
|
||||||
|
## Prompting
|
||||||
|
The v0.2 models are trained on ChatML, the prompting structure goes a little something like this:
|
||||||
|
|
||||||
|
```
|
||||||
|
<|im_start|>user
|
||||||
|
Hi there!<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
Nice to meet you!<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
Can I ask a question?<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
### Context and Instruct
|
||||||
|
The v0.2 models are trained on ChatML, please use that Context and Instruct template.
|
||||||
|
|
||||||
|
### Current Top Sampler Settings
|
||||||
|
[Spicy_Temp](https://files.catbox.moe/9npj0z.json) <br/>
|
||||||
|
[Violet_Twilight-Nitral-Special](https://files.catbox.moe/ot54u3.json) <br/>
|
||||||
|
|
||||||
|
## Training
|
||||||
|
Training was done twice over 2 epochs each on two 2x [NVIDIA A6000 GPUs](https://www.nvidia.com/en-us/design-visualization/rtx-a6000/) using LoRA. A two-phased approach was used in which the base model was trained 2 epochs on RP data, the LoRA was then applied to base. Finally, the new modified base was trained 2 epochs on instruct, and the new instruct LoRA was applied to the modified base, resulting in what you see here.
|
||||||
|
|
||||||
|
[<img src="https://raw.githubusercontent.com/axolotl-ai-cloud/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/axolotl-ai-cloud/axolotl)
|
||||||
Reference in New Issue
Block a user