初始化项目，由ModelHub XC社区提供模型

Model: FallenMerick/MN-Chunky-Lotus-12B
Source: Original Platform

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,90 @@
+---
+license: cc-by-4.0
+language:
+- en
+base_model:
+- TheDrummer/Rocinante-12B-v1.1
+- Epiculous/Violet_Twilight-v0.2
+- nbeerbower/mistral-nemo-gutenberg-12B-v4
+- flammenai/Mahou-1.5-mistral-nemo-12B
+library_name: transformers
+tags:
+- storywriting
+- text adventure
+- creative
+- story
+- writing
+- fiction
+- roleplaying
+- rp
+- mergekit
+- merge
+
+---
+
+![pic](https://huggingface.co/FallenMerick/MN-Chunky-Lotus-12B/resolve/main/chunky-lotus.jpg)
+
+# MN-Chunky-Lotus-12B
+
+I had originally planned to use this model for future/further merges, but decided to go ahead and release it since it scored rather high on my local EQ Bench testing (79.58 w/ 100% parsed @ 8-bit).
+</br>
+Bear in mind that most models tend to score a bit higher on my own local tests as compared to their posted scores. Still, its the highest score I've personally seen from all the models I've tested.
+</br>
+Its a decent model, with great emotional intelligence and acceptable adherence to various character personalities. It does a good job at roleplaying despite being a bit bland at times.
+</br>
+</br>
+Overall, I like the way it writes, but it has a few formatting issues that show up from time to time, and it has an uncommon tendency to paste walls of character feelings/intentions at the end of some outputs without any prompting. This is something I hope to correct with future iterations.
+</br>
+</br>
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+GGUF quants:
+* https://huggingface.co/backyardai/MN-Chunky-Lotus-12B-GGUF
+* https://huggingface.co/mradermacher/MN-Chunky-Lotus-12B-GGUF
+* https://huggingface.co/mradermacher/MN-Chunky-Lotus-12B-i1-GGUF
+* https://huggingface.co/FallenMerick/MN-Chunky-Lotus-12B-GGUF
+
+## Merge Details
+### Merge Method
+
+This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [Epiculous/Violet_Twilight-v0.2](https://huggingface.co/Epiculous/Violet_Twilight-v0.2)
+* [nbeerbower/mistral-nemo-gutenberg-12B-v4](https://huggingface.co/nbeerbower/mistral-nemo-gutenberg-12B-v4)
+* [flammenai/Mahou-1.5-mistral-nemo-12B](https://huggingface.co/flammenai/Mahou-1.5-mistral-nemo-12B)
+
+### Configuration
+
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: Epiculous/Violet_Twilight-v0.2
+    parameters:
+      weight: 1.0
+      density: 1.0
+  - model: nbeerbower/mistral-nemo-gutenberg-12B-v4
+    parameters:
+      weight: 1.0
+      density: 0.54
+  - model: flammenai/Mahou-1.5-mistral-nemo-12B
+    parameters:
+      weight: 1.0
+      density: 0.26
+merge_method: ties
+base_model: TheDrummer/Rocinante-12B-v1.1
+parameters:
+  normalize: true
+dtype: bfloat16
+
+```
+The idea behind this recipe was to take the long-form writing capabilities of Gutenberg, curtail it a bit with the very short output formatting of Mahou, and use Violet Twilight as an extremely solid roleplaying foundation underneath.
+</br>
+Rocinante is used as the base model in this merge in order to really target the delta weights from Gutenberg, since those seemed to have the highest impact on the resulting EQ of the model.
+</br>
+</br>
+Special shoutout to [@matchaaaaa](https://huggingface.co/matchaaaaa) for helping with testing, and for all the great model recommendations. Also, for just being an all around great person who's really inspired and motivated me to continue merging and working on models.

config.json

@@ -0,0 +1,27 @@
+{
+  "_name_or_path": "FallenMerick/MN-Chunky-Lotus-12B",
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 131072,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 40,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.46.0",
+  "use_cache": true,
+  "vocab_size": 131072
+}

mergekit_config.yml

@@ -0,0 +1,18 @@
+models:
+  - model: Epiculous/Violet_Twilight-v0.2
+    parameters:
+      weight: 1.0
+      density: 1.0
+  - model: nbeerbower/mistral-nemo-gutenberg-12B-v4
+    parameters:
+      weight: 1.0
+      density: 0.54
+  - model: flammenai/Mahou-1.5-mistral-nemo-12B
+    parameters:
+      weight: 1.0
+      density: 0.26
+merge_method: ties
+base_model: TheDrummer/Rocinante-12B-v1.1
+parameters:
+  normalize: true
+dtype: bfloat16

model-00001-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:572f3050b5930e4886fb7ccc86ccb3f8d82a65c4570eb5d0b922f542acc82133
+size 4865489336

model-00002-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:dcc3ab446cb0eddf9b17df50a3931451ed66393d7a2a029243612ad4170aec0f
+size 4907529456

model-00003-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90b1eab5c83e8aebf9714de7348602cb3f58cba470de8e7919f07b1ecf6c04d8
+size 4907529464

model-00004-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a316abafb47eeec4e21ad5b0b05529b40d509fb68628c581083a899fd1622fe4
+size 4907529456

model-00005-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a672dc5fee5eac277d08a9e8aeba5daf313933696ea7d82729e2000feebc25ac
+size 4907529392

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b0240ce510f08e6c2041724e9043e33be9d251d1e4a4d94eb68cd47b954b61d2
+size 17078292