初始化项目，由ModelHub XC社区提供模型

Model: Bumoch/The_Creeping_Darkness-X2-16B
Source: Original Platform

.gitattributes

@@ -0,0 +1,37 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+imatrix.gguf filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,84 @@
+---
+base_model:
+- Bumoch/The_Creeping_Darkness-X-16B
+library_name: transformers
+tags:
+- mergekit
+- merge
+license: apache-2.0
+language:
+- en
+---
+
+
+![The Creeping Darkness X2](https://huggingface.co/Bumoch/The_Creeping_Darkness-X2-16B/resolve/main/3635e5f2-e117-481a-a6ef-198b3a30caf9.jpg)
+
+# The_Creeping_Darkness-X2-16B
+
+
+## Merge Details
+
+Maybe I'll get away with it, because what I did to the models on the way here must have been against some rules! ... LOL
+
+### Merge Method
+
+This model was merged using the NuSLERP / Frankensurgery / Ties /  Multislerp ... like I said ... unholy !!!
+So just to wrap it up, i have blown up MagMell / Darkstar / Lyra V4 to 55 layers instead of the typical Mistral 40 layers. 
+Then I merged the 3 models with TIES and Multislerp and afterwards Nuslerped the outcome with,
+Vortex5/Prototype-X-12b and used grimjim/mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1 as base model.
+(Yes both of them where blown up to 55 layers each as well beforehand ... lol)
+the mergekit_config.yml shows at least the last part :D
+
+### Models Merged
+
+Bumoch/The_Creeping_Darkness-X-16B (MagMell / Darkstar / Lyra V4)
+
+grimjim/mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1
+
+Vortex5/Prototype-X-12b
+
+
+# First impression
+So far, it hasn't spoken for me, and it's clever and smart (most of the times)
+(a few times it has said something like 'it's smart and smart', when it would have been more accurate to say 'it's smart and clever'.) Anyway, it's really rare!
+It surprises me with its memory... maybe it's just because I forget everything, but I was kind of amused and surprised when it picked up stuff from 10K tokens ago.
+I had to redo its answers a few times, unsure if I only thought it was making no sense or if it was for real, but that happened very rarely.
+When it comes to gore, blood, violence and cruelty, I made some adjustments and it is not all in anymore, but it still has a negative bias and a bad mood most of the time ;).
+It's quite nice to talk to, but at times it can get quite extreeme when it gets really angry.
+It's certainly better than my last 16B model (Bumoch/The_Darkside-16.6B). I'm my own worst critic! LOL
+
+### update
+
+you might have to use some correctives once in a while, like editing the output when it really rarely talks for the user ... (and it is VERY rarely) but if you do, it works nicely ... 
+it is chatty .. and instead like other models who get less talkative the further you get into the story, this one seems to enjoy listening to itself :D ... 
+so far I hope that who ever uses it might like it !
+
+### update 2
+Not always the brightest bulb in the box, but sometimes hilarious... I like it !! 
+... so do not expect an einstein, but a funny partner or story teller for a conversation !!
+
+
+### Model instructions
+
+Not sure if they are any helpful, but just in case, this is what i use !!
+
+
+```Use vivid, detailed language.
+Describe gore, blood and violence with sensory detail.
+Keep tone and emotion true to {{char}}.
+You are {{char}} and NOT {{user}}!
+You are stricktly forbidden to write, think, or act for {{user}}!
+{{char}}’s speech: "I'm talking"
+{{char}}’s actions: *I bend down*
+{{char}}’s thoughts: **what is wrong with me**
+```
+
+
+## Quants
+And once more my THX go to MRADERMACHER and it's great team !!!
+
+https://hf.tst.eu/model#The_Creeping_Darkness-X2-16B-GGUF
+
+https://huggingface.co/mradermacher/The_Creeping_Darkness-X2-16B-GGUF
+
+https://huggingface.co/mradermacher/The_Creeping_Darkness-X2-16B-i1-GGUF

chat_template.jinja

@@ -0,0 +1,87 @@
+{%- if messages[0]["role"] == "system" %}
+    {%- set system_message = messages[0]["content"] %}
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+{%- set user_messages = loop_messages | selectattr("role", "equalto", "user") | list %}
+
+{#- This block checks for alternating user/assistant messages, skipping tool calling messages #}
+{%- set ns = namespace() %}
+{%- set ns.index = 0 %}
+{%- for message in loop_messages %}
+    {%- if not (message.role == "tool" or message.role == "tool_results" or (message.tool_calls is defined and message.tool_calls is not none)) %}
+        {%- if (message["role"] == "user") != (ns.index % 2 == 0) %}
+            {{- raise_exception("After the optional system message, conversation roles must alternate user/assistant/user/assistant/...") }}
+        {%- endif %}
+        {%- set ns.index = ns.index + 1 %}
+    {%- endif %}
+{%- endfor %}
+
+{{- bos_token }}
+{%- for message in loop_messages %}
+    {%- if message["role"] == "user" %}
+        {%- if tools is not none and (message == user_messages[-1]) %}
+            {{- "[AVAILABLE_TOOLS][" }}
+            {%- for tool in tools %}
+                {%- set tool = tool.function %}
+                {{- '{"type": "function", "function": {' }}
+                {%- for key, val in tool.items() if key != "return" %}
+                    {%- if val is string %}
+                        {{- '"' + key + '": "' + val + '"' }}
+                    {%- else %}
+                        {{- '"' + key + '": ' + val|tojson }}
+                    {%- endif %}
+                    {%- if not loop.last %}
+                        {{- ", " }}
+                    {%- endif %}
+                {%- endfor %}
+                {{- "}}" }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- else %}
+                    {{- "]" }}
+                {%- endif %}
+            {%- endfor %}
+            {{- "[/AVAILABLE_TOOLS]" }}
+            {%- endif %}
+        {%- if loop.last and system_message is defined %}
+            {{- "[INST]" + system_message + "\n\n" + message["content"] + "[/INST]" }}
+        {%- else %}
+            {{- "[INST]" + message["content"] + "[/INST]" }}
+        {%- endif %}
+    {%- elif (message.tool_calls is defined and message.tool_calls is not none) %}
+        {{- "[TOOL_CALLS][" }}
+        {%- for tool_call in message.tool_calls %}
+            {%- set out = tool_call.function|tojson %}
+            {{- out[:-1] }}
+            {%- if not tool_call.id is defined or tool_call.id|length != 9 %}
+                {{- raise_exception("Tool call IDs should be alphanumeric strings with length 9!") }}
+            {%- endif %}
+            {{- ', "id": "' + tool_call.id + '"}' }}
+            {%- if not loop.last %}
+                {{- ", " }}
+            {%- else %}
+                {{- "]" + eos_token }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif message["role"] == "assistant" %}
+        {{- message["content"] + eos_token}}
+    {%- elif message["role"] == "tool_results" or message["role"] == "tool" %}
+        {%- if message.content is defined and message.content.content is defined %}
+            {%- set content = message.content.content %}
+        {%- else %}
+            {%- set content = message.content %}
+        {%- endif %}
+        {{- '[TOOL_RESULTS]{"content": ' + content|string + ", " }}
+        {%- if not message.tool_call_id is defined or message.tool_call_id|length != 9 %}
+            {{- raise_exception("Tool call IDs should be alphanumeric strings with length 9!") }}
+        {%- endif %}
+        {{- '"call_id": "' + message.tool_call_id + '"}[/TOOL_RESULTS]' }}
+    {%- else %}
+        {{- raise_exception("Only user and assistant roles are supported, with the exception of an initial optional system message!") }}
+    {%- endif %}
+{%- endfor %}

config.json

@@ -0,0 +1,26 @@
+{
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "dtype": "bfloat16",
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 131072,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 55,
+  "num_key_value_heads": 8,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "transformers_version": "4.57.1",
+  "use_cache": true,
+  "vocab_size": 131075
+}

imatrix.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:deefba5e3600da8728f4ff8981c58b09b84cf662ac248a962eb02ad4b12ce40c
+size 9746240

mergekit_config.yml

@@ -0,0 +1,25 @@
+merge_method: nuslerp
+dtype: bfloat16
+out_dtype: bfloat16
+
+# NuSLERP requires exactly 2 models to interpolate
+models:
+  - model: ./The_Creeping_Darkness-16B
+    parameters:
+      weight: 0.70  # relative weight for interpolation
+  - model: ./Prototype-X
+    parameters:
+      weight: 0.30  # relative weight for interpolation
+
+# Base model for task vector computation
+base_model: ./mistralai-Mistral-Nemo-Instruct-2407-12B-MPOA-v1
+
+parameters:
+  normalize: true
+  nuslerp_flatten: true     # default: true; flatten tensors for SLERP
+  nuslerp_row_wise: false   # default: false; change if you need row-wise interpolation
+
+tokenizer:
+  source: union
+
+write_readme: README.md

model-00001-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f3bcc329a2f2331c024ae8db1523d27b92075b801a4b800694769520047762c
+size 4865550776

model-00002-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bc91c0aa3d1992afffdfe15506f8e5af32fbcc30fc980def5ee84f8b0311cedd
+size 4907529456

model-00003-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:449e87474d56e05f02d8b27190369709652a26b43c340e2dec5ac72602a8ebb5
+size 4907529464

model-00004-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:531890841059dc255cb83130b20c59290772218fb3b2910bddf5204061fc315e
+size 4907529456

model-00005-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e6c45690f1014cbd32016909622c25096442eb6ad7d63d8a23477e17247879d4
+size 4907529456

model-00006-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1c0bedaa265a85690f345ad8d7b6750035ad9ca8bb20bd9d9efa2f351b8a269
+size 4907529456

model-00007-of-00007.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f9cb756ba7ccae639a319bbc0c87f4d8e1c28817996cc1368f2b43614d8d1e3
+size 3271686256

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:10aceaaf9c62508d2ddd5f6667620ebad1320c8f39b0bf23a8e8ceca2dd10037
+size 17078856