初始化项目，由ModelHub XC社区提供模型

Model: ibm-granite/granite-4.0-h-tiny
Source: Original Platform

.gitattributes

@@ -0,0 +1,53 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bin.* filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zstandard filter=lfs diff=lfs merge=lfs -text
+*.tfevents* filter=lfs diff=lfs merge=lfs -text
+*.db* filter=lfs diff=lfs merge=lfs -text
+*.ark* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
+**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
+ 
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.gguf* filter=lfs diff=lfs merge=lfs -text
+*.ggml filter=lfs diff=lfs merge=lfs -text
+*.llamafile* filter=lfs diff=lfs merge=lfs -text
+*.pt2 filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+
+model-00001-of-00003.safetensors filter=lfs diff=lfs merge=lfs -text
+model-00002-of-00003.safetensors filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text
+vocab.json filter=lfs diff=lfs merge=lfs -text
+model-00003-of-00003.safetensors filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,611 @@
+---
+license: apache-2.0
+library_name: transformers
+tags:
+- language
+- granite-4.0
+---
+
+[![mof-class3-qualified](https://mot.isitopen.ai/modules/mof/assets/badge_class3_qualified.png)](https://mot.isitopen.ai/model/1161)
+
+# Granite-4.0-H-Tiny
+
+📣 **Update [10-07-2025]:** Added a *default system prompt* to the chat template to guide the model towards more *professional, accurate, and safe* responses.
+
+**Model Summary:**
+Granite-4.0-H-Tiny is a 7B parameter long-context instruct model finetuned from *Granite-4.0-H-Tiny-Base* using a combination of open source instruction datasets with permissive license and internally collected synthetic datasets. This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging. Granite 4.0 instruct models feature improved *instruction following (IF)* and *tool-calling* capabilities, making them more effective in enterprise applications.
+
+- **Developers:** Granite Team, IBM
+- **HF Collection:** [Granite 4.0 Language Models HF Collection](https://huggingface.co/collections/ibm-granite/granite-40-language-models-6811a18b820ef362d9e5a82c)
+- **GitHub Repository:** [ibm-granite/granite-4.0-language-models](https://github.com/ibm-granite/granite-4.0-language-models)
+- **Website**: [Granite Docs](https://www.ibm.com/granite/docs/) 
+- **Release Date**: October 2nd, 2025
+- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
+
+**Supported Languages:** 
+English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 4.0 models for languages beyond these languages.
+
+**Intended use:** 
+The model is designed to respond to general instructions and can be used to build AI assistants for multiple domains, including business applications.
+
+*Capabilities*
+* Summarization
+* Text classification
+* Text extraction
+* Question-answering
+* Retrieval Augmented Generation (RAG)
+* Code related tasks
+* Function-calling tasks
+* Multilingual dialog use cases
+* Fill-In-the-Middle (FIM) code completions
+
+<!-- <todo>Need to test the examples. (especially the tool calling and RAG ones)</todo>
+ -->
+ 
+**Generation:** 
+This is a simple example of how to use Granite-4.0-H-Tiny model.
+
+Install the following libraries:
+
+```shell
+pip install torch torchvision torchaudio
+pip install accelerate
+pip install transformers
+```
+Then, copy the snippet from the section that is relevant for your use case.
+
+```python
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+device = "cuda"
+model_path = "ibm-granite/granite-4.0-h-tiny"
+tokenizer = AutoTokenizer.from_pretrained(model_path)
+# drop device_map if running on CPU
+model = AutoModelForCausalLM.from_pretrained(model_path, device_map=device)
+model.eval()
+# change input text as desired
+chat = [
+    { "role": "user", "content": "Please list one IBM Research laboratory located in the United States. You should only output its name and location." },
+]
+chat = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=True)
+# tokenize the text
+input_tokens = tokenizer(chat, return_tensors="pt").to(device)
+# generate output tokens
+output = model.generate(**input_tokens, 
+                        max_new_tokens=100)
+# decode output tokens into text
+output = tokenizer.batch_decode(output)
+# print output
+print(output[0])
+```
+
+Expected output:
+```shell
+<|start_of_role|>system<|end_of_role|>You are a helpful assistant. Please ensure responses are professional, accurate, and safe.<|end_of_text|>
+<|start_of_role|>user<|end_of_role|>Please list one IBM Research laboratory located in the United States. You should only output its name and location.<|end_of_text|>
+<|start_of_role|>assistant<|end_of_role|>Almaden Research Center, San Jose, California<|end_of_text|>
+```
+
+**Tool-calling:** 
+Granite-4.0-H-Tiny comes with enhanced tool calling capabilities, enabling seamless integration with external functions and APIs. To define a list of  tools please follow OpenAI's function [definition schema](https://platform.openai.com/docs/guides/function-calling?api-mode=responses#defining-functions). 
+
+This is an example of how to use Granite-4.0-H-Tiny model tool-calling ability:
+
+```python
+tools = [
+    {
+        "type": "function",
+        "function": {
+            "name": "get_current_weather",
+            "description": "Get the current weather for a specified city.",
+            "parameters": {
+                "type": "object",
+                "properties": {
+                    "city": {
+                        "type": "string",
+                        "description": "Name of the city"
+                    }
+                },
+                "required": ["city"]
+            }
+        }
+    }
+]
+
+# change input text as desired
+chat = [
+    { "role": "user", "content": "What's the weather like in Boston right now?" },
+]
+chat = tokenizer.apply_chat_template(chat, \
+                                     tokenize=False, \
+                                     tools=tools, \
+                                     add_generation_prompt=True)
+# tokenize the text
+input_tokens = tokenizer(chat, return_tensors="pt").to(device)
+# generate output tokens
+output = model.generate(**input_tokens, 
+                        max_new_tokens=100)
+# decode output tokens into text
+output = tokenizer.batch_decode(output)
+# print output
+print(output[0])
+```
+
+Expected output:
+```shell
+<|start_of_role|>system<|end_of_role|>You are a helpful assistant with access to the following tools. You may call one or more tools to assist with the user query.
+
+You are provided with function signatures within <tools></tools> XML tags:
+<tools>
+{"type": "function", "function": {"name": "get_current_weather", "description": "Get the current weather for a specified city.", "parameters": {"type": "object", "properties": {"city": {"type": "string", "description": "Name of the city"}}, "required": ["city"]}}}
+</tools>
+
+For each tool call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:
+<tool_call>
+{"name": <function-name>, "arguments": <args-json-object>}
+</tool_call>. If a tool does not exist in the provided list of tools, notify the user that you do not have the ability to fulfill the request.<|end_of_text|>
+<|start_of_role|>user<|end_of_role|>What's the weather like in Boston right now?<|end_of_text|>
+<|start_of_role|>assistant<|end_of_role|><tool_call>
+{"name": "get_current_weather", "arguments": {"city": "Boston"}}
+</tool_call><|end_of_text|>
+```
+
+<!-- **Retrieval Augmented Generation:** 
+*Coming soon* -->
+
+**Evaluation Results:** 
+
+<table>
+<!--   <caption><b> All Results</b></caption> -->
+<thead>
+  <tr>
+    <th style="text-align:left; background-color: #001d6c; color: white;">Benchmarks</th>
+    <th style="text-align:left; background-color: #001d6c; color: white;">Metric</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">Micro Dense</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Micro Dense</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Tiny MoE</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Small MoE</th>
+  </tr>
+</thead>
+  <tbody>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    General Tasks
+  </td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MMLU</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">5-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">65.98</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">67.43</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">68.65</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">78.44</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MMLU-Pro</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">5-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">44.5</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">43.48</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">44.94</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">55.47</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">BBH</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">3-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">72.48</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">69.36</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">66.34</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">81.62</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">AGI EVAL</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">0-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">64.29</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">59</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">62.15</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">70.63</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">GPQA</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">0-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">30.14</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">32.15</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">32.59</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">40.63</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Alignment Tasks
+  </td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">AlpacaEval 2.0</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;"></td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">29.49</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">31.49</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">30.61</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">42.48</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">IFEval</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">Instruct, Strict</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">85.5</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">86.94</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">84.78</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">89.87</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">IFEval</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">Prompt, Strict</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">79.12</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">81.71</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">78.1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">85.22</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">IFEval</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">Average</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">82.31</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">84.32</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">81.44</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">87.55</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">ArenaHard</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;"></td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">25.84</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">36.15</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">35.75</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">46.48</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Math Tasks
+  </td>
+</tr>      
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">GSM8K</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">8-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">85.45</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">81.35</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">84.69</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">87.27</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">GSM8K Symbolic</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">8-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">79.82</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">77.5</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">81.1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">87.38</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">Minerva Math</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">0-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">62.06</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">66.44</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">69.64</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">74</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">DeepMind Math</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">0-shot, CoT</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">44.56</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">43.83</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">49.92</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">59.33</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Code Tasks
+  </td>
+</tr> 
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">HumanEval</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">80</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">81</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">83</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">88</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">HumanEval+</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">72</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">75</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">76</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">83</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MBPP</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">72</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">73</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">80</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">84</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MBPP+</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">64</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">64</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">69</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">71</td>
+</tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">CRUXEval-O</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">41.5</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">41.25</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">39.63</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">50.25</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">BigCodeBench</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">39.21</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">37.9</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">41.06</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">46.23</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Tool Calling Tasks
+  </td>
+</tr> 
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">BFCL v3</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;"></td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">59.98</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">57.56</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">57.65</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">64.69</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Multilingual Tasks
+  </td>
+</tr> 
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MULTIPLE</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">pass@1</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">49.21</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">49.46</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">55.83</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">57.37</td>
+</tr> 
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MMMLU</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">5-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">55.14</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">55.19</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">61.87</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">69.69</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">INCLUDE</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">5-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">51.62</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">50.51</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">53.12</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">63.97</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MGSM</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">8-shot</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">28.56</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">44.48</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">45.36</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">38.72</td>
+</tr>
+<tr>
+  <td colspan="6" style="text-align:center; background-color:  #FFFFFF; color: #2D2D2D; font-style:italic;">
+    Safety
+  </td>
+</tr> 
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">SALAD-Bench</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;"></td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">97.06</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">96.28</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">97.77</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">97.3</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">AttaQ</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;"></td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">86.05</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">84.44</td>
+    <td style="text-align:right; background-color: #DAE8FF; color: #2D2D2D;">86.61</td>
+    <td style="text-align:right; background-color: #FFFFFF; color: #2D2D2D;">86.64</td>
+</tr>
+</tbody></table>
+
+
+<table>
+  <caption><b>Multilingual Benchmarks and thr included languages:</b></caption>
+<thead>
+  <tr>
+    <th style="text-align:left; background-color: #001d6c; color: white;">Benchmarks</th>
+    <th style="text-align:left; background-color: #001d6c; color: white;"># Langs</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">Languages</th>
+  </tr>
+</thead>
+<tbody>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MMMLU</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: #2D2D2D;">11</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">ar, de, en, es, fr, ja, ko, pt, zh, bn, hi</td>
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">INCLUDE</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: #2D2D2D;">14</td>
+<!--     <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">hindi, bengali, tamil, telugu, arabic, german, spanish, french, italian, japanese, korean, dutch, portuguese, chinese</td> -->
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">hi, bn, ta, te, ar, de, es, fr, it, ja, ko, nl, pt, zh</td>
+    
+</tr>
+<tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">MGSM</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: #2D2D2D;">5</td>
+    <td style="text-align:left; background-color: #FFFFFF; color: #2D2D2D;">en, es, fr, ja, zh</td>
+</tr>
+</tbody>
+</table>
+
+**Model Architecture:** 
+Granite-4.0-H-Tiny baseline is built on a decoder-only MoE transformer architecture. Core components of this architecture are: GQA, Mamba2, MoEs with shared experts, SwiGLU activation, RMSNorm, and shared input/output embeddings.
+
+<table>
+<thead>
+  <tr>
+    <th style="text-align:left; background-color: #001d6c; color: white;">Model</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">Micro Dense</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Micro Dense</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Tiny MoE</th>
+    <th style="text-align:center; background-color: #001d6c; color: white;">H Small MoE</th>
+  </tr></thead>
+<tbody>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Embedding size</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">2560</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">2048</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">1536</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">4096</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Number of layers</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">40 attention</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">4 attention / 36 Mamba2</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">4 attention / 36 Mamba2</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">4 attention / 36 Mamba2</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Attention head size</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">64</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">64</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">128</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Number of attention heads</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">40</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">32</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">12</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">32</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Number of KV heads</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">8</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">8</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">4</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">8</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Mamba2 state size</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">128</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Number of Mamba2 heads</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">64</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">48</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128</td>
+  </tr>
+
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">MLP / Shared expert hidden size</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">8192</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">8192</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">1024</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">1536</td>
+  </tr>
+    
+
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Num. Experts</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">64</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">72</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Num. active Experts</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">6</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">10</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Expert hidden size</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">-</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">512</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">768</td>
+  </tr>
+
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">MLP activation</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">SwiGLU</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">SwiGLU</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">SwiGLU</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">SwiGLU</td>
+  </tr>
+
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Sequence length</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128K</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128K</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">128K</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">128K</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;">Position embedding</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">RoPE</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">NoPE</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">NoPE</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">NoPE</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;"># Parameters</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">3B</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">3B</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">7B</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">32B</td>
+  </tr>
+  <tr>
+    <td style="text-align:left; background-color: #FFFFFF; color: black;"># Active parameters</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">3B</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">3B</td>
+    <td style="text-align:center; background-color: #DAE8FF; color: black;">1B</td>
+    <td style="text-align:center; background-color: #FFFFFF; color: black;">9B</td>
+  </tr>
+</tbody></table>
+
+**Training Data:** 
+Overall, our SFT data is largely comprised of three key sources: (1) publicly available datasets with permissive license, (2) internal synthetic data targeting specific capabilities, and (3) a select set of human-curated data.
+
+**Infrastructure:**
+We trained the Granite 4.0 Language Models utilizing an NVIDIA GB200 NVL72 cluster hosted in CoreWeave. Intra-rack communication occurs via the 72-GPU NVLink domain, and a non-blocking, full Fat-Tree NDR 400 Gb/s InfiniBand network provides inter-rack communication. This cluster provides a scalable and efficient infrastructure for training our models over thousands of GPUs.
+
+**Ethical Considerations and Limitations:** 
+Granite 4.0 Instruction Models are primarily finetuned using instruction-response pairs mostly in English, but also multilingual data covering multiple languages. Although this model can handle multilingual dialog use cases, its performance might not be similar to English tasks. In such case, introducing a small number of examples (few-shot) can help the model in generating more accurate outputs. While this model has been aligned by keeping safety in consideration, the model may in some cases produce inaccurate, biased, or unsafe responses to user prompts. So we urge the community to use this model with proper safety testing and tuning tailored for their specific tasks.
+
+**Resources**
+- ⭐️ Learn about the latest updates with Granite: https://www.ibm.com/granite
+- 📄 Get started with tutorials, best practices, and prompt engineering advice: https://www.ibm.com/granite/docs/
+- 💡 Learn about the latest Granite learning resources: https://ibm.biz/granite-learning-resources
+
+<!-- ## Citation
+```
+@misc{granite-models,
+  author = {author 1, author2, ...},
+  title = {},
+  journal = {},
+  volume = {},
+  year = {2024},
+  url = {https://arxiv.org/abs/0000.00000},
+}
+``` -->

chat_template.jinja

@@ -0,0 +1,118 @@
+{%- set tools_system_message_prefix = 'You are a helpful assistant with access to the following tools. You may call one or more tools to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>'  %}
+{%- set tools_system_message_suffix = '\n</tools>\n\nFor each tool call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call>. If a tool does not exist in the provided list of tools, notify the user that you do not have the ability to fulfill the request.' %}
+{%- set documents_system_message_prefix = 'You are a helpful assistant with access to the following documents. You may use one or more documents to assist with the user query.\n\nYou are given a list of documents within <documents></documents> XML tags:\n<documents>' %}
+{%- set documents_system_message_suffix = '\n</documents>\n\nWrite the response to the user\'s input by strictly aligning with the facts in the provided documents. If the information needed to answer the question is not available in the documents, inform the user that the question cannot be answered based on the available data.' %}
+{%- set g4_default_system_message = 'You are a helpful assistant. Please ensure responses are professional, accurate, and safe.' %}
+{%- if available_tools is defined and available_tools %}
+    {%- set tools = available_tools %}
+{%- endif %}
+{%- set ns = namespace(tools_system_message=tools_system_message_prefix,
+                       documents_system_message=documents_system_message_prefix,
+                       default_system_message=g4_default_system_message,
+                       system_message=''
+                       ) %}
+{%- if tools %}
+    {%- for tool in tools %}
+        {%- set ns.tools_system_message = ns.tools_system_message + '\n' + (tool | tojson) %}
+    {%- endfor %}
+    {%- set ns.tools_system_message = ns.tools_system_message + tools_system_message_suffix %}
+{%- else %}
+    {%- set ns.tools_system_message = '' %}
+{%- endif %}
+{%- if documents %}
+    {%- for document in documents %}
+        {%- set ns.documents_system_message = ns.documents_system_message + '\n' + (document | tojson) %}
+    {%- endfor %}
+    {%- set ns.documents_system_message = ns.documents_system_message + documents_system_message_suffix %}
+{%- else %}
+    {%- set ns.documents_system_message = '' %}
+{%- endif %}
+{%- if messages[0].role == 'system' %}
+    {%- if messages[0].content is string %}
+        {%- set ns.system_message = messages[0].content %}
+    {%- elif messages[0].content is iterable %}
+        {%- for entry in messages[0].content %}
+            {%- if entry.type== 'text' %}
+                {%- if ns.system_message != '' %}
+                    {%- set ns.system_message = ns.system_message + '\n' %}
+                {%- endif %}
+                {%- set ns.system_message = ns.system_message + entry.text %}
+            {%- endif %}
+        {%- endfor %}
+    {%- endif %}
+    {%- if tools and documents %}
+        {%- set ns.system_message = ns.system_message + '\n\n' +  ns.tools_system_message + '\n\n' + ns.documents_system_message %}
+    {%- elif tools %}
+        {%- set ns.system_message = ns.system_message + '\n\n' + ns.tools_system_message %}
+    {%- elif documents %}
+        {%- set ns.system_message = ns.system_message + '\n\n' + ns.documents_system_message %}
+    {%- endif %}
+{%- else %}
+    {%- if tools and documents %}
+        {%- set ns.system_message = ns.tools_system_message + '\n\n' + ns.documents_system_message  %}
+    {%- elif tools %}
+        {%- set ns.system_message = ns.tools_system_message %}
+    {%- elif documents %}
+        {%- set ns.system_message = ns.documents_system_message %}
+    {%- endif %}
+{%- endif %}
+{%- if ns.system_message %}
+    {{- '<|start_of_role|>system<|end_of_role|>' + ns.system_message + '<|end_of_text|>\n' }}
+{%- else %}
+    {{- '<|start_of_role|>system<|end_of_role|>' + ns.default_system_message + '<|end_of_text|>\n' }}
+{%- endif %}
+{%- for message in messages %}
+    {%- set content = namespace(val='') %}
+    {%- if message.content is string %}
+        {%- set content.val = message.content %}
+    {%- else %}
+        {%- if message.content is iterable %}
+            {%- for entry in message.content %}
+                {%- if entry.type== 'text' %}
+                    {%- if content.val != '' %}
+                        {%- set content.val = content.val + '\n' %}
+                    {%- endif %}
+                    {%- set content.val = content.val + entry.text %}
+                {%- endif %}
+            {%- endfor %}
+        {%- endif %}
+    {%- endif %}
+    {%- if (message.role == 'user') or (message.role == 'system' and not loop.first) %}
+        {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val + '<|end_of_text|>\n' }}
+    {%- elif message.role == 'assistant' %}
+        {{- '<|start_of_role|>' + message.role + '<|end_of_role|>' + content.val }}
+        {%- if message.tool_calls %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if (loop.first and content.val) or (not loop.first) %}
+                    {{- '\n' }}
+                {%- endif %}
+                {%- if tool_call.function %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {{- '<tool_call>\n{"name": "' }}
+                {{- tool_call.name }}
+                {{- '", "arguments": ' }}
+                {%- if tool_call.arguments is string %}
+                    {{- tool_call.arguments }}
+                {%- else %}
+                    {{- tool_call.arguments | tojson }}
+                {%- endif %}
+                {{- '}\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|end_of_text|>\n' }}
+    {%- elif message.role == 'tool' %}
+        {%- if loop.first or (messages[loop.index0 - 1].role != 'tool') %}
+            {{- '<|start_of_role|>user<|end_of_role|>' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content.val }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != 'tool') %}
+            {{- '<|end_of_text|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|start_of_role|>assistant<|end_of_role|>' }}
+{%- endif %}

config.json

@@ -0,0 +1,89 @@
+{
+  "architectures": [
+    "GraniteMoeHybridForCausalLM"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "attention_multiplier": 0.0078125,
+  "bos_token_id": 100257,
+  "embedding_multiplier": 12,
+  "eos_token_id": 100257,
+  "hidden_act": "silu",
+  "hidden_size": 1536,
+  "initializer_range": 0.1,
+  "intermediate_size": 512,
+  "layer_types": [
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "attention",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "attention",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "attention",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba",
+    "attention",
+    "mamba",
+    "mamba",
+    "mamba",
+    "mamba"
+  ],
+  "logits_scaling": 6,
+  "mamba_chunk_size": 256,
+  "mamba_conv_bias": true,
+  "mamba_d_conv": 4,
+  "mamba_d_head": 64,
+  "mamba_d_state": 128,
+  "mamba_expand": 2,
+  "mamba_n_groups": 1,
+  "mamba_n_heads": 48,
+  "mamba_proj_bias": false,
+  "max_position_embeddings": 131072,
+  "model_type": "granitemoehybrid",
+  "normalization_function": "rmsnorm",
+  "num_attention_heads": 12,
+  "num_experts_per_tok": 6,
+  "num_hidden_layers": 40,
+  "num_key_value_heads": 4,
+  "num_local_experts": 64,
+  "output_router_logits": false,
+  "pad_token_id": 100256,
+  "position_embedding_type": "nope",
+  "residual_multiplier": 0.22,
+  "rms_norm_eps": 1e-05,
+  "rope_scaling": null,
+  "rope_theta": 10000,
+  "router_aux_loss_coef": 0.0,
+  "shared_intermediate_size": 1024,
+  "tie_word_embeddings": true,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.56.0",
+  "use_cache": true,
+  "vocab_size": 100352
+}

configuration.json

@@ -0,0 +1 @@
+{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 100257,
+  "eos_token_id": 100257,
+  "pad_token_id": 100256,
+  "transformers_version": "4.56.0"
+}

model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d79109218e59c850b26146a40d5c2dd7084ac8e569e53a59e2dcb78a16529f73
+size 4924822608

model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f15b2625114d52bbe658050732687683a3596e14fab4a817d3147549ac609ef3
+size 4879018632

model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:825bf48c51808ce93042dc9ff65e6b8b76131fac76b8bda4183cff32abf39c83
+size 4074301016

model.safetensors.index.json

@@ -0,0 +1,594 @@
+{
+  "metadata": {
+    "total_parameters": 6939037248,
+    "total_size": 13878074496
+  },
+  "weight_map": {
+    "model.embed_tokens.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.0.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.1.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.10.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.11.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.12.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.13.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.13.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.13.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.14.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.15.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.16.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.17.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.18.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.19.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.2.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.2.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.20.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.20.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.21.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.22.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.23.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.24.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.k_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.o_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.q_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.self_attn.v_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.25.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.26.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.block_sparse_moe.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.block_sparse_moe.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.block_sparse_moe.router.layer.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.input_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.A_log": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.D": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.conv1d.bias": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.conv1d.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.dt_bias": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.in_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.norm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.mamba.out_proj.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.post_attention_layernorm.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.shared_mlp.input_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.27.shared_mlp.output_linear.weight": "model-00002-of-00003.safetensors",
+    "model.layers.28.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.28.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.29.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.3.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.3.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.30.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.30.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.31.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.32.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.33.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.34.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.self_attn.k_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.self_attn.o_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.self_attn.q_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.self_attn.v_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.35.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.36.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.37.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.38.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.block_sparse_moe.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.block_sparse_moe.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.block_sparse_moe.router.layer.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.input_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.A_log": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.D": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.conv1d.bias": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.conv1d.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.dt_bias": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.in_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.norm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.mamba.out_proj.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.post_attention_layernorm.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.shared_mlp.input_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.39.shared_mlp.output_linear.weight": "model-00003-of-00003.safetensors",
+    "model.layers.4.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.4.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.k_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.o_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.q_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.self_attn.v_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.5.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.6.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.7.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.8.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.block_sparse_moe.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.block_sparse_moe.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.block_sparse_moe.router.layer.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.input_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.A_log": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.D": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.conv1d.bias": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.conv1d.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.dt_bias": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.in_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.norm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.mamba.out_proj.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.shared_mlp.input_linear.weight": "model-00001-of-00003.safetensors",
+    "model.layers.9.shared_mlp.output_linear.weight": "model-00001-of-00003.safetensors",
+    "model.norm.weight": "model-00003-of-00003.safetensors"
+  }
+}

special_tokens_map.json

@@ -0,0 +1,30 @@
+{
+  "bos_token": {
+    "content": "<|end_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "<|end_of_text|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|pad|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<|unk|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e2bad66439538cb4d5a7580680932432ed9ece9d3b8577e675512bdf11599253
+size 7153421

tokenizer_config.json

@@ -0,0 +1,783 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "100256": {
+      "content": "<|pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100257": {
+      "content": "<|end_of_text|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100258": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100259": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100260": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100261": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100262": {
+      "content": "<|filename|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100263": {
+      "content": "<|reponame|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100264": {
+      "content": "<|start_of_role|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100265": {
+      "content": "<|end_of_role|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100266": {
+      "content": "<|unused_1|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100267": {
+      "content": "<|start_of_plugin|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100268": {
+      "content": "<|end_of_plugin|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100269": {
+      "content": "<|unk|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100270": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100271": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100272": {
+      "content": "<tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100273": {
+      "content": "</tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100274": {
+      "content": "<think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100275": {
+      "content": "</think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "100276": {
+      "content": "<think_on>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100277": {
+      "content": "<think_off>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100278": {
+      "content": "<schema>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100279": {
+      "content": "</schema>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100280": {
+      "content": "<tools>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100281": {
+      "content": "</tools>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100282": {
+      "content": "<documents>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100283": {
+      "content": "</documents>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100284": {
+      "content": "<|unused_15|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100285": {
+      "content": "<|unused_16|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100286": {
+      "content": "<|unused_17|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100287": {
+      "content": "<|unused_18|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100288": {
+      "content": "<|unused_19|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100289": {
+      "content": "<|unused_20|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100290": {
+      "content": "<|unused_21|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100291": {
+      "content": "<|unused_22|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100292": {
+      "content": "<|unused_23|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100293": {
+      "content": "<|unused_24|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100294": {
+      "content": "<|unused_25|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100295": {
+      "content": "<|unused_26|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100296": {
+      "content": "<|unused_27|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100297": {
+      "content": "<|unused_28|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100298": {
+      "content": "<|unused_29|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100299": {
+      "content": "<|unused_30|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100300": {
+      "content": "<|unused_31|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100301": {
+      "content": "<|unused_32|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100302": {
+      "content": "<|unused_33|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100303": {
+      "content": "<|unused_34|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100304": {
+      "content": "<|unused_35|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100305": {
+      "content": "<|unused_36|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100306": {
+      "content": "<|unused_37|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100307": {
+      "content": "<|unused_38|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100308": {
+      "content": "<|unused_39|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100309": {
+      "content": "<|unused_40|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100310": {
+      "content": "<|unused_41|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100311": {
+      "content": "<|unused_42|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100312": {
+      "content": "<|unused_43|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100313": {
+      "content": "<|unused_44|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100314": {
+      "content": "<|unused_45|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100315": {
+      "content": "<|unused_46|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100316": {
+      "content": "<|unused_47|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100317": {
+      "content": "<|unused_48|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100318": {
+      "content": "<|unused_49|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100319": {
+      "content": "<|unused_50|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100320": {
+      "content": "<|unused_51|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100321": {
+      "content": "<|unused_52|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100322": {
+      "content": "<|unused_53|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100323": {
+      "content": "<|unused_54|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100324": {
+      "content": "<|unused_55|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100325": {
+      "content": "<|unused_56|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100326": {
+      "content": "<|unused_57|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100327": {
+      "content": "<|unused_58|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100328": {
+      "content": "<|unused_59|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100329": {
+      "content": "<|unused_60|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100330": {
+      "content": "<|unused_61|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100331": {
+      "content": "<|unused_62|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100332": {
+      "content": "<|unused_63|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100333": {
+      "content": "<|unused_64|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100334": {
+      "content": "<|unused_65|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100335": {
+      "content": "<|unused_66|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100336": {
+      "content": "<|unused_67|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100337": {
+      "content": "<|unused_68|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100338": {
+      "content": "<|unused_69|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100339": {
+      "content": "<|unused_70|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100340": {
+      "content": "<|unused_71|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100341": {
+      "content": "<|unused_72|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100342": {
+      "content": "<|unused_73|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100343": {
+      "content": "<|unused_74|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100344": {
+      "content": "<|unused_75|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100345": {
+      "content": "<|unused_76|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100346": {
+      "content": "<|unused_77|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100347": {
+      "content": "<|unused_78|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100348": {
+      "content": "<|unused_79|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100349": {
+      "content": "<|unused_80|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100350": {
+      "content": "<|unused_81|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100351": {
+      "content": "<|unused_82|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "bos_token": "<|end_of_text|>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|end_of_text|>",
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<|pad|>",
+  "padding_side": "left",
+  "tokenizer_class": "GPT2Tokenizer",
+  "unk_token": "<|unk|>"
+}

vocab.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3efa1cc7301ba3f2c0cb36f4c9ec1ece4e10eaadc60d29462013269769c161fb
+size 2014114