初始化项目，由ModelHub XC社区提供模型

Model: LyraNovaHeart/Stellar-Odyssey-12b-v0.0
Source: Original Platform

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,86 @@
+---
+base_model: []
+library_name: transformers
+tags:
+- mergekit
+- merge
+
+---
+# Stellar Odyssey 12b v0.0
+*Join my dream, it's just the right time, whoa... Leave it all behind... Get ready now... Riise up into my world~*
+
+Listen to the song on youtube: https://www.youtube.com/watch?v=npyiiInMA0w
+
+This is my second attempt at a model merge, This time, these models were used
+
+- mistralai/Mistral-Nemo-Base-2407
+- Sao10K/MN-12B-Lyra-v4
+- nothingiisreal/MN-12B-Starcannon-v2
+- Gryphe/Pantheon-RP-1.5-12b-Nemo
+
+Intended Use case: Roleplay
+
+Instruction Format: ChatML
+
+Thank you to AuriAetherwiing for helping me merge the models.
+
+# Data?
+
+This is a hard question to answer, I didn't add any data to the model itself, rather it's a merge of other models, so the data used for them applies to this model too, though it won't be the same.
+
+
+# License
+
+cc-by-nc-4.0, unless you contact me and have been given explicit permission by me to host for commercial services. I will NOT accept offers from any of the following
+
+- Infermatic AI
+- "AI Girlfriend" apps or any that pray on loneliness to attract customers.
+- Anyone that refuses to identify who they are and who runs the operation, even if under NDA.
+- Any services that are predatory or exploit other people.
+
+The only providers I have authorized to host my model are Featherless.AI/Recursal, ArliAI and WyvernChat.
+
+## Merge Details
+
+This model was merged using the della_linear merge method using mistralai/Mistral-Nemo-Base-2407 as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* Sao10K/MN-12B-Lyra-v4
+* Gryphe/Pantheon-RP-1.5-12b-Nemo
+* nothingiisreal/MN-12B-Starcannon-v2
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: C:\Users\\Downloads\Mergekit-Fixed\mergekit\Sao10K_MN-12B-Lyra-v4
+    parameters:
+      weight: 0.3
+      density: 0.25
+  - model: C:\Users\\Downloads\Mergekit-Fixed\mergekit\nothingiisreal_MN-12B-Starcannon-v2
+    parameters:
+      weight: 0.1
+      density: 0.4
+  - model: C:\Users\\Downloads\Mergekit-Fixed\mergekit\Gryphe_Pantheon-RP-1.5-12b-Nemo
+    parameters:
+      weight: 0.4
+      density: 0.5
+merge_method: della_linear
+base_model: C:\Users\\Downloads\Mergekit-Fixed\mergekit\mistralai_Mistral-Nemo-Base-2407
+parameters:
+  epsilon: 0.05
+  lambda: 1
+merge_method: della_linear
+dtype: bfloat16
+```
+
+## Notes
+
+Della_Linear: Refer to https://arxiv.org/abs/2406.11617 and https://arxiv.org/abs/2212.04089, as it is quite long to explain what Della_Linear is
+BFloat16: Brain Floating Point 16, a way to run models faster on Nvidia GPUs
+Density: Fraction of weights in differences from the base model to retain
+Epsilon: Maximum change in drop probability based on magnitude. Drop probabilities assigned will range

config.json

@@ -0,0 +1,27 @@
+{
+  "_name_or_path": "C:\\Users\\lg911\\Downloads\\Mergekit-Fixed\\mergekit\\mistralai_Mistral-Nemo-Base-2407",
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 1024000,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 40,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.44.0",
+  "use_cache": true,
+  "vocab_size": 131072
+}

mergekit_config.yml

@@ -0,0 +1,20 @@
+models:
+  - model: C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\Sao10K_MN-12B-Lyra-v4
+    parameters:
+      weight: 0.3
+      density: 0.25
+  - model: C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\nothingiisreal_MN-12B-Starcannon-v2
+    parameters:
+      weight: 0.1
+      density: 0.4
+  - model: C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\Gryphe_Pantheon-RP-1.5-12b-Nemo
+    parameters:
+      weight: 0.4
+      density: 0.5
+merge_method: della_linear
+base_model: C:\Users\lg911\Downloads\Mergekit-Fixed\mergekit\mistralai_Mistral-Nemo-Base-2407
+parameters:
+  epsilon: 0.05
+  lambda: 1
+merge_method: della_linear
+dtype: bfloat16

model-00001-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3afa391215e16f9cc2fca0004e54b96cc955b0f9d9348f427746ee13ecf41935
+size 4865489336

model-00002-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb11e1b74ea9be076e736041509942137d1a6596b5887b5ae7f944aa70428121
+size 4907529456

model-00003-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06619ccb5754a190b02256004a8b4a3ea050a8a4fa1f11585414576124572e2a
+size 4907529464

model-00004-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e169c24f344164328c0a071326823d2edd1d5fa5056247582615f69cb0a6dd5
+size 4907529456

model-00005-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c71e12dfb303c1b943869a28fbf32866238f54cbf9fff780dfa3e06840ce7e9
+size 4907529392

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}