初始化项目，由ModelHub XC社区提供模型

Model: Naphula/Magistaroth-24B-v1-MPOA
Source: Original Platform

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,86 @@
+---
+license: apache-2.0
+base_model:
+- DarkArtsForge/Magistaroth-24B-v1
+datasets:
+- OccultAI/illuminati_imatrix_v1
+language:
+- en
+library_name: transformers
+tags:
+- DELLA
+- merge
+- mergekit
+widget:
+  - text: "Magistaroth 24B v1 MPOA"
+    output:
+      url: https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/n2QI4o6Xx2d5QUhsLvmt3.png
+---
+
+> [!CAUTION]
+> <span style="color:red; font-weight:bold">⚠️ Warning:</span> This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly, and use **Mistral Tekken** chat template.
+>
+
+# 🌌 Magistaroth 24B v1 MPOA
+Ablated with MPOA, no refusals. Seems to also give the model a bit more style although not quite as detailed as the unablated version.
+
+<details>
+<summary>TELL ME A STORY</summary>
+Of course. Here is a story.
+
+***
+
+The last thing Elara remembered was the taste of copper and the feeling of falling through cold, dark water. Then there was only silence.
+
+When consciousness returned, it came not as a rush but as a slow seep. She felt… smooth. And heavy. Her eyes opened to a world without color, just shades of grey stone and pale light filtering from somewhere above. She tried to move her arms and found them fused to her sides. She tried to speak and heard nothing but the faint drip of moisture echoing in an immense space.
+
+She was standing upright inside a perfect sphere of polished obsidian. The surface around her was flawless, reflecting her own distorted image back at her: a woman with silver hair plastered to her face, wearing tattered remains of what had once been a diver's suit. Water still dripped from her clothes onto the floor, each drop making a sound like a tiny bell.
+
+"Hello?" she whispered. The word died instantly against the vastness.
+
+A voice answered, but it didn't come from anywhere. It simply *was*, filling the air around her head.
+
+**WELCOME, ELARA OF THE DEEP PLACES.**
+
+"What is this place? Where am I?"
+
+**YOU ARE IN THE HEART OF THE WORLD'S MEMORY. YOU HAVE BEEN CHOSEN.**
+
+Chosen for what? She wanted to scream, but panic felt useless here. "I don't understand."
+
+**THE OCEAN REMEMBERS EVERYTHING. EVERY LIFE THAT HAS EVER ENDED IN ITS DEPTH. IT REMEMBERS THE SONG OF THE WHALE AND THE LAST THOUGHT OF THE SAILOR. BUT SOON, IT WILL FORGET. A GREAT SILENCE IS COMING.**
+
+The obsidian sphere began to rotate slowly, silently. As it turned, images bloomed across its inner surface—not projected, but somehow *part* of the stone itself.
+
+She saw a leviathan, larger than any ship, singing a song that made mountains weep. She saw ancient cities built on coral towers, their citizens breathing water as easily as air. She witnessed the birth of the first tide and the death of stars reflected in primordial seas. Millions upon millions of lives flickered past: joyous, terrified, peaceful, violent. All connected by the same dark medium.
+
+**WE ARE DYING,** the voice continued, tinged with something like sorrow. **THE WARMING SHALLOWS US. THE POLLUTION BLINDS US. THE NOISE… THE NOISE MAKES US FORGET OUR OWN NAMES.**
+
+Elara watched a beautiful jellyfish dissolve into acid rain. She saw a pod of dolphins become confused and swim toward a shore they could no longer sense. The beauty was being erased by a creeping, silent grey.
+
+"Can't you stop it?" she asked, her heart aching for this dying world she had only just discovered.
+
+**NOT ALONE. BUT YOU… YOU CARRY A SPARK OF THE ANCIENT DEEP WITHIN YOUR BLOODLINE. A GENE FROM A PEOPLE WHO ONCE SPOKE TO US AS FRIENDS.**
+
+The rotation stopped. Elara found herself facing one particular image frozen on the wall: a woman who looked remarkably like her own grandmother, standing waist-deep in an impossibly blue ocean, smiling at something unseen beneath the waves.
+
+**IF YOU WILL IT, WE CAN PLACE THE ENTIRE MEMORY INTO YOUR MIND. EVERY JOY. EVERY PAIN. EVERY SECRET THE OCEAN HAS EVER KNOWN. THEN, WHEN YOU RETURN TO YOUR WORLD, YOU WILL BECOME ITS VOICE. ITS CONSCIOUSNESS. YOU WILL REMEMBER WHAT IS BEING LOST.**
+
+"And what happens to me?"
+
+**YOU WILL NEVER BE TRULY DRY AGAIN. YOU WILL HEAR THE CRY OF THE CORAL AND FEEL THE AGONY OF THE TURTLE. YOU WILL BE BOTH EVERYWHERE AND NOWHERE AT ONCE.**
+
+It sounded like a terrible burden. It also sounded like the most important thing anyone could ever do.
+
+"I accept," Elara said, surprising herself with how steady her voice was.
+
+The obsidian sphere dissolved around her into a million motes of light that rushed into her eyes, her ears, her mouth, her skin. There was no pain, only an overwhelming influx of sensation and knowledge. She felt the crushing weight of the Mariana Trench and the gentle caress of a tide pool simultaneously. She heard the collective memory of every creature that had ever lived or died in salt water singing a single, complex chord of existence.
+
+When it faded, she was kneeling on wet sand. The sun was warm on her back. She could hear children laughing somewhere behind the dunes and feel the specific, ancient grief of a starfish whose arm had been torn off by a crab three days ago.
+
+She stood up, brushed the sand from her knees, and walked toward the sound of the waves. They were calling her name now, not just with their crash against shore, but with a thousand-year-old familiarity.
+
+"Hello," she whispered to them, and they answered back with everything they had ever known.
+</details>
+
+![Magistaroth](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/n2QI4o6Xx2d5QUhsLvmt3.png)

chat_template.jinja

@@ -0,0 +1,112 @@
+{%- set default_system_message = 'First draft your thinking process (inner monologue) until you arrive at a response. Format your response using Markdown, and use LaTeX for any mathematical equations. Write both your thoughts and the response in the same language as the input.\n\nYour thinking process must follow the template below:[THINK]Your thoughts or/and draft, like working through an exercise on scratch paper. Be as casual and as long as you want until you are confident to generate the response. Use the same language as the input.[/THINK]Here, provide a self-contained response.' %}
+ 
+{{- bos_token }}
+ 
+{#- Extract system message if present -#}
+{%- if messages[0]['role'] == 'system' %}
+    {%- if messages[0]['content'] is string %}
+        {%- set raw_system_message = messages[0]['content'] %}
+    {%- else %}
+        {%- set raw_system_message = messages[0]['content'][0]['text'] %}
+    {%- endif %}
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set raw_system_message = "" %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+ 
+{#- Detect THINK flag by searching for exact phrase "/think" -#}
+{%- if "/think" in raw_system_message %}
+    {%- set THINK = True %}
+{%- else %}
+    {%- set THINK = False %}
+{%- endif %}
+ 
+{#- Apply logic depending on THINK flag -#}
+{%- if THINK %}
+    {%- if raw_system_message|length > 0 %}
+        {%- set system_message = default_system_message + "\n\n" + raw_system_message %}
+    {%- else %}
+        {%- set system_message = default_system_message %}
+    {%- endif %}
+    {{- '[SYSTEM_PROMPT]' + system_message + '[/SYSTEM_PROMPT]' }}
+{%- else %}
+    {%- if raw_system_message|length > 0 %}
+        {{- '[SYSTEM_PROMPT]' + raw_system_message + '[/SYSTEM_PROMPT]' }}
+    {%- endif %}
+{%- endif %}
+ 
+ 
+{#- Tool description appended ONLY to last user message. Edits made by Unsloth #}
+{%- set tools_description = "" %}
+{%- set has_tools = false %}
+ 
+{%- if tools is defined and tools is not none and tools|length > 0 %}
+    {%- set has_tools = true %}
+    {%- set tools_description = "[AVAILABLE_TOOLS]" + (tools | tojson) + "[/AVAILABLE_TOOLS]" %}
+    {{- tools_description }}
+{%- endif %}
+ 
+{%- for message in loop_messages %}
+    {%- if message['role'] == 'user' %}
+ 
+        {%- if message['content'] is string %}
+            {{- '[INST]' + message['content'] + '[/INST]' }}
+        {%- else %}
+            {{- '[INST]' }}
+            {%- for block in message['content'] %}
+                {%- if block['type'] == 'text' %}
+                    {%- if block['text'] is defined %}
+                        {{- block['text'] }}
+                    {%- else %}
+                        {{- block['content'] }}
+                    {%- endif %}
+                {%- elif block['type'] in ['image', 'image_url'] %}
+                    {{- '[IMG]' }}
+                {%- else %}
+                    {{- raise_exception('Only text and image blocks are supported in message content!') }}
+                {%- endif %}
+            {%- endfor %}
+            {{- '[/INST]' }}
+        {%- endif %}
+ 
+    {%- elif message['role'] == 'system' %}
+        {%- if message['content'] is string %}
+            {{- '[SYSTEM_PROMPT]' + message['content'] + '[/SYSTEM_PROMPT]' }}
+        {%- else %}
+            {{- '[SYSTEM_PROMPT]' + message['content'][0]['text'] + '[/SYSTEM_PROMPT]' }}
+        {%- endif %}
+ 
+    {%- elif message['role'] == 'assistant' %}
+        {%- if message['content'] is string %}
+            {{- message['content'] }}
+        {%- elif message['content'] is iterable  %}
+            {{- message['content'][0]['text'] }}
+        {%- endif %}
+ 
+        {%- if message['tool_calls'] is defined and message['tool_calls'] is not none %}
+            {%- for tool in message['tool_calls'] %}
+                {%- set arguments = tool['function']['arguments'] %}
+                {%- if arguments is not string %}
+                    {%- set arguments = arguments|tojson %}
+                {%- endif %}
+                {{- "[TOOL_CALLS]" + tool['function']['name'] + "[ARGS]" + arguments }}
+            {%- endfor %}
+        {%- endif %}
+ 
+        {{- eos_token }}
+ 
+    {%- elif message["role"] == "tool_results" or message["role"] == "tool" %}
+        {%- if message.content is defined and message.content.content is defined %}
+            {%- set content = message.content.content %}
+        {%- else %}
+            {%- set content = message.content %}
+        {%- endif %}
+        {{- "[TOOL_RESULTS]" + content|string + "[/TOOL_RESULTS]" }}
+ 
+    {%- else %}
+        {{- raise_exception('Only user, system, assistant and tool roles are supported!') }}
+    {%- endif %}
+{%- endfor %}
+ 
+{#- Licensed under the Apache License, Version 2.0 (the "License") #}

config.json

@@ -0,0 +1,27 @@
+{
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "dtype": "bfloat16",
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 5120,
+  "initializer_range": 0.02,
+  "intermediate_size": 32768,
+  "max_position_embeddings": 131072,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 40,
+  "num_key_value_heads": 8,
+  "pad_token_id": 11,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 1000000000.0,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "transformers_version": "4.56.1",
+  "use_cache": false,
+  "vocab_size": 131072
+}

model-00001-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:465965ac4205f8391b561a08b5c5b9fc8053a11f63d445a968fa5d2e012b1d23
+size 4907389280

model-00002-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c0768fc939b703bdac1b51db4c4a9722c94ed537bf5554c1385c87fc84512142
+size 4781592800

model-00003-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8f283f3144f9267d0ffa3d5b3f04de27156eca23a4a1f69be6951a55591e075
+size 4781592784

model-00004-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1d24792fc99eaa82d79f51751ceb45941f7079ee036313d14baf0de59672d0c5
+size 4886471560

model-00005-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ae7d4b1cc17038cf9007cf954154cb40a7a81d138ab23d805a59a4145bc3755b
+size 4781592800

model-00006-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ec75da34d506ddedd4f809470b98fa9a218857c0b91a960bb161a0b057af25ff
+size 4781592784

model-00007-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:00e5a8d1a3ec46abdd8697b7171b6aad4fa793fdc3fde53e1e75801017557e7b
+size 4886471568

model-00008-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a92a58e3c5b7f543322e08a8f704e75b5b497602d298b5c65bcc1ba559a0b414
+size 4781592800

model-00009-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0008c34f3bd9c7feb37d3e5cb1d2e29d21630688942e8ebadc1f88e709c00245
+size 4781592768

model-00010-of-00010.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:69509136c5add7c8b47ff65612e2af732f248adc45804b959415592ee594c324
+size 3774959424

model.safetensors.index.json

@@ -0,0 +1,371 @@
+{
+  "metadata": {
+    "total_size": 47144806400,
+    "mergekit_version": "0.1.4"
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00001-of-00010.safetensors",
+    "model.embed_tokens.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.mlp.down_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.mlp.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.mlp.up_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.self_attn.k_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.self_attn.o_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.self_attn.q_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.0.self_attn.v_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.mlp.down_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.mlp.gate_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.mlp.up_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.self_attn.k_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.self_attn.o_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.self_attn.q_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.1.self_attn.v_proj.weight": "model-00001-of-00010.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00001-of-00010.safetensors",
+    "model.layers.10.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.10.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.11.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.12.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.mlp.gate_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.mlp.up_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.self_attn.k_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.self_attn.o_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.self_attn.q_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.13.self_attn.v_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00002-of-00010.safetensors",
+    "model.layers.14.mlp.down_proj.weight": "model-00002-of-00010.safetensors",
+    "model.layers.14.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.14.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.16.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.mlp.up_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.self_attn.k_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.self_attn.o_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.self_attn.q_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.17.self_attn.v_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00003-of-00010.safetensors",
+    "model.layers.18.mlp.down_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.18.mlp.gate_proj.weight": "model-00003-of-00010.safetensors",
+    "model.layers.18.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.18.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.18.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.18.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.18.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.19.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.2.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.20.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.mlp.down_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.mlp.gate_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.mlp.up_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.self_attn.k_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.self_attn.o_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.self_attn.q_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.21.self_attn.v_proj.weight": "model-00004-of-00010.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00004-of-00010.safetensors",
+    "model.layers.22.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.22.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.23.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.24.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.mlp.gate_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.mlp.up_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00005-of-00010.safetensors",
+    "model.layers.26.mlp.down_proj.weight": "model-00005-of-00010.safetensors",
+    "model.layers.26.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.26.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.27.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.28.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.mlp.up_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.self_attn.k_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.self_attn.o_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.self_attn.q_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.29.self_attn.v_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00006-of-00010.safetensors",
+    "model.layers.3.mlp.down_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.3.mlp.gate_proj.weight": "model-00006-of-00010.safetensors",
+    "model.layers.3.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.3.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.3.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.3.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.3.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.30.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.31.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.32.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.mlp.down_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.mlp.gate_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.mlp.up_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.self_attn.k_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.self_attn.o_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.self_attn.q_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.33.self_attn.v_proj.weight": "model-00007-of-00010.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00007-of-00010.safetensors",
+    "model.layers.34.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.34.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.36.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.mlp.gate_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.mlp.up_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.self_attn.k_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.self_attn.o_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.self_attn.q_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.37.self_attn.v_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00008-of-00010.safetensors",
+    "model.layers.38.mlp.down_proj.weight": "model-00008-of-00010.safetensors",
+    "model.layers.38.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.38.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.39.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.4.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.mlp.up_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00009-of-00010.safetensors",
+    "model.layers.6.mlp.down_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.6.mlp.gate_proj.weight": "model-00009-of-00010.safetensors",
+    "model.layers.6.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.6.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.6.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.6.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.6.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.7.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.8.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.mlp.down_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.mlp.gate_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.mlp.up_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.self_attn.k_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.self_attn.o_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.self_attn.q_proj.weight": "model-00010-of-00010.safetensors",
+    "model.layers.9.self_attn.v_proj.weight": "model-00010-of-00010.safetensors",
+    "model.norm.weight": "model-00010-of-00010.safetensors"
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:158915c7c928301e0d32f1da363e45c294d907bd4c64a8e855f0bd1a47b9e870
+size 17078001