BAAI/RoboBrain2.5-8B-MT
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: BAAI/RoboBrain2.5-8B-MT
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-25 20:04:13 +08:00
commit 98cfd1dab6
15 changed files with 1372 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

53
.gitattributes vendored Normal file
View File

@@ -0,0 +1,53 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.gguf* filter=lfs diff=lfs merge=lfs -text
*.ggml filter=lfs diff=lfs merge=lfs -text
*.llamafile* filter=lfs diff=lfs merge=lfs -text
*.pt2 filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
merges.txt filter=lfs diff=lfs merge=lfs -text
model-00002-of-00002.safetensors filter=lfs diff=lfs merge=lfs -text
model-00001-of-00002.safetensors filter=lfs diff=lfs merge=lfs -text
vocab.json filter=lfs diff=lfs merge=lfs -text
tokenizer.json filter=lfs diff=lfs merge=lfs -text

186
README.md Normal file
View File

@@ -0,0 +1,186 @@
---
license: apache-2.0
---
<div align="center">
<img src="https://github.com/FlagOpen/RoboBrain2.5/raw/main/assets/logo2.png" width="500"/>
</div>
<h1 align="center">RoboBrain 2.5: Depth in Sight, Time in Mind. </h1>
<p align="center">
</a>&nbsp&nbsp⭐️ <a href="https://superrobobrain.github.io/">Project Page</a></a>&nbsp&nbsp | &nbsp&nbsp📑 <a href="https://arxiv.org/abs/2601.14352">Technical Report</a>&nbsp&nbsp | &nbsp&nbsp🤗 <a href="https://huggingface.co/collections/BAAI/robobrain25/">Hugging Face</a>&nbsp&nbsp | &nbsp&nbsp🤖 <a href="https://github.com/FlagOpen/RoboBrain2.5">Github</a>&nbsp&nbsp
</p>
## 🔥 Overview
**RoboBrain-2.5** is a next-generation Embodied AI foundation model that significantly evolves its predecessor's core capabilities in general perception, spatial reasoning, and temporal modeling through extensive training on high-quality spatiotemporal data. It achieves a paradigm shift in 3D Spatial Reasoning, transitioning from 2D relative points to predicting 3D coordinates with depth information, understanding absolute metric constraints, and generating complete manipulation trajectories tailored for complex tasks with physical constraints. Furthermore, it establishes a breakthrough in Temporal Value Prediction by constructing a General Reward Modeling Method that provides dense progress tracking and multi-granular execution state estimation across varying viewpoints. This empowers VLA reinforcement learning with immediate, dense feedback signals, enabling robots to achieve high task success rates and robustness in fine-grained manipulation scenarios.
<div align="center">
<img src="https://github.com/FlagOpen/RoboBrain2.5/raw/main/assets/teasor.png" />
</div>
## 🚀 Key Highlights
### 1. Comprehensive Upgrade in ✨ Native 3D Spatial Reasoning ✨
Compared to version 2.0, **RoboBrain-2.5** achieves a leap in spatial perception and reasoning capabilities:
* **From 2D to 3D:** Upgraded from predicting coordinate points on 2D images to predicting coordinate points with depth information in **3D space** (3D Spatial Referring).
* **Relative to Absolute:** Evolved from understanding relative spatial relationships to measuring **absolute 3D spatial metric information** (3D Spatial Measuring). The model can comprehend precise physical constraint instructions (e.g., "hovering 1-5 cm above").
* **Point to Trace:** Advanced from predicting a single target point for pick-and-place to predicting a **series of key points** that describe the complete manipulation process (3D Spatial Trace), naturally possessing spatial planning capabilities with 3D absolute metrics.
### 2. Breakthrough in ✨ Dense Temporal Value Estimation ✨
**RoboBrain-2.5** makes significant progress in temporal modeling by constructing a General Reward Model (GRM):
* **Dense Progress Prediction:** Capable of multi-granularity task progress prediction across different tasks, viewpoints, and embodiments.
* **Execution State Estimation:** Understands task goals and estimates various states during execution (e.g., success, failure, error occurrence).
* **Empowering VLA Reinforcement Learning:** Provides real-time, dense feedback signals and rewards for VLA (Vision-Language-Action) reinforcement learning. With only **one demonstration**, it achieves a task success rate of **95%+** in complex, fine-grained manipulations.
### 3. More Powerful Core Capabilities from previous version 2.0
**RoboBrain 2.5** also maintains the three core capabilities of version 2.0, which supports ***interactive reasoning*** with long-horizon planning and closed-loop feedback, ***spatial perception*** for precise point and bbox prediction from complex instructions, ***temporal perception*** for future trajectory estimation, and ***scene reasoning*** through real-time structured memory construction and update.
## 🛠️ Setup
```bash
# clone repo.
git clone https://github.com/FlagOpen/RoboBrain2.5.git
cd RoboBrain2.5
# build conda env.
conda create -n robobrain2_5 python=3.10
conda activate robobrain2_5
pip install -r requirements.txt
```
## 💡 Quickstart
### 1. Usage for General VQA
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example:
prompt = "What is shown in this image?"
image = "http://images.cocodataset.org/val2017/000000039769.jpg"
pred = model.inference(prompt, image, task="general")
print(f"Prediction:\n{pred}")
```
### 2. Usage for Visual Grounding (VG)
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example:
prompt = "the person wearing a red hat"
image = "./assets/demo/grounding.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt, image, task="grounding", plot=True, do_sample=False)
print(f"Prediction:\n{pred}")
```
### 3. Usage for Affordance Prediction (Embodied)
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example:
prompt = "the affordance area for holding the cup"
image = "./assets/demo/affordance.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt, image, task="pointing", plot=True, do_sample=False)
print(f"Prediction:\n{pred}")
```
### 4. Usage for Refering Prediction (Embodied)
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example:
prompt = "Identify spot within the vacant space that's between the two mugs"
image = "./assets/demo/pointing.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt, image, task="pointing", plot=True, do_sample=True)
print(f"Prediction:\n{pred}")
```
### 5. Usage for Navigation Tasks (Embodied)
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example 1:
prompt_1 = "Identify spot within toilet in the house"
image = "./assets/demo/navigation.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt_1, image, task="pointing", plot=True, do_sample=True)
print(f"Prediction:\n{pred}")
# Example 2:
prompt_2 = "Identify spot within the sofa in the house"
image = "./assets/demo/navigation.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt_2, image, task="pointing", plot=True, do_sample=True)
print(f"Prediction:\n{pred}")
```
### 6. Usage for ✨ 3D Trajectory Prediction ✨ (Embodied)
```python
from inference import UnifiedInference
model = UnifiedInference("BAAI/RoboBrain2.5-8B-NV")
# Example:
prompt = "reach for the banana on the plate"
image = "./assets/demo/trajectory.jpg"
# Visualization results will be saved to ./result, if `plot=True`.
pred = model.inference(prompt, image, task="trajectory", plot=True, do_sample=False)
print(f"Prediction:\n{pred}")
```
### 7. Usage for ✨ Temporal Value Estimation ✨ (Embodied)
***We highly recommend referring to [Robo-Dopamine](https://github.com/FlagOpen/Robo-Dopamine) for detailed usage instructions.***
```bash
# clone Robo-Dopamine repo.
git clone https://github.com/FlagOpen/Robo-Dopamine.git
cd Robo-Dopamine
```
```python
import os
from examples.inference import GRMInference
# model = GRMInference("tanhuajie2001/Robo-Dopamine-GRM-3B")
model = GRMInference("BAAI/RoboBrain2.5-8B-NV")
TASK_INSTRUCTION = "organize the table"
BASE_DEMO_PATH = "./examples/demo_table"
GOAL_IMAGE_PATH = "./examples/demo_table/goal_image.png"
OUTPUT_ROOT = "./results"
output_dir = model.run_pipeline(
cam_high_path = os.path.join(BASE_DEMO_PATH, "cam_high.mp4"),
cam_left_path = os.path.join(BASE_DEMO_PATH, "cam_left_wrist.mp4"),
cam_right_path = os.path.join(BASE_DEMO_PATH, "cam_right_wrist.mp4"),
out_root = OUTPUT_ROOT,
task = TASK_INSTRUCTION,
frame_interval = 30,
batch_size = 1,
goal_image = GOAL_IMAGE_PATH,
eval_mode = "incremental",
visualize = True
)
print(f"Episode ({BASE_DEMO_PATH}) processed with Incremental-Mode. Output at: {output_dir}")
```

3
chat_template.json Normal file
View File

File diff suppressed because one or more lines are too long

62
config.json Normal file
View File

@@ -0,0 +1,62 @@
{
"architectures": [
"Qwen3VLForConditionalGeneration"
],
"image_token_id": 151655,
"model_type": "qwen3_vl",
"text_config": {
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 151643,
"dtype": "bfloat16",
"eos_token_id": 151645,
"head_dim": 128,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 12288,
"max_position_embeddings": 262144,
"model_type": "qwen3_vl_text",
"num_attention_heads": 32,
"num_hidden_layers": 36,
"num_key_value_heads": 8,
"rms_norm_eps": 1e-06,
"rope_scaling": {
"mrope_interleaved": true,
"mrope_section": [
24,
20,
20
],
"rope_type": "default"
},
"rope_theta": 5000000,
"use_cache": true,
"vocab_size": 151936
},
"tie_word_embeddings": false,
"transformers_version": "4.57.0.dev0",
"video_token_id": 151656,
"vision_config": {
"deepstack_visual_indexes": [
8,
16,
24
],
"depth": 27,
"hidden_act": "gelu_pytorch_tanh",
"hidden_size": 1152,
"in_channels": 3,
"initializer_range": 0.02,
"intermediate_size": 4304,
"model_type": "qwen3_vl",
"num_heads": 16,
"num_position_embeddings": 2304,
"out_hidden_size": 4096,
"patch_size": 16,
"spatial_merge_size": 2,
"temporal_patch_size": 2
},
"vision_end_token_id": 151653,
"vision_start_token_id": 151652
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

14
generation_config.json Normal file
View File

@@ -0,0 +1,14 @@
{
"bos_token_id": 151643,
"pad_token_id": 151643,
"do_sample": true,
"eos_token_id": [
151645,
151643
],
"top_k": 20,
"top_p": 0.8,
"repetition_penalty": 1.0,
"temperature": 0.7,
"transformers_version": "4.56.0"
}

3
merges.txt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:599bab54075088774b1733fde865d5bd747cbcc7a547c5bc12610e874e26f5e3
size 1671839

3
model-00001-of-00002.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:69f0ea3355ee66baa74c71e3585847634d742fa848b256804d6486aab45db77d
size 9914019048

3
model-00002-of-00002.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b5bcb82ee193e002113d9c4ca97cb8fd97a321d300de95a247c897b9ebdfae91
size 7620320504

757
model.safetensors.index.json Normal file
View File

@@ -0,0 +1,757 @@
{
"metadata": {
"total_size": 17534247392
},
"weight_map": {
"lm_head.weight": "model-00002-of-00002.safetensors",
"model.language_model.embed_tokens.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.0.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.1.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.10.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.11.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.12.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.13.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.14.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.15.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.16.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.17.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.18.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.19.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.19.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.19.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.19.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.19.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.2.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.20.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.20.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.21.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.22.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.23.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.24.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.25.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.26.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.27.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.28.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.29.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.3.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.3.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.30.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.30.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.31.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.32.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.33.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.34.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.input_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.mlp.down_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.mlp.gate_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.mlp.up_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.post_attention_layernorm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.k_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.k_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.o_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.q_norm.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.q_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.35.self_attn.v_proj.weight": "model-00002-of-00002.safetensors",
"model.language_model.layers.4.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.4.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.5.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.6.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.7.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.8.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.input_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.mlp.down_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.mlp.gate_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.mlp.up_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.post_attention_layernorm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.k_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.k_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.o_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.q_norm.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.q_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.layers.9.self_attn.v_proj.weight": "model-00001-of-00002.safetensors",
"model.language_model.norm.weight": "model-00002-of-00002.safetensors",
"model.visual.blocks.0.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.0.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.1.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.10.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.11.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.12.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.13.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.14.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.15.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.16.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.17.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.18.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.19.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.2.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.20.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.21.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.22.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.23.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.24.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.25.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.26.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.3.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.4.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.5.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.6.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.7.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.8.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.attn.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.attn.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.attn.qkv.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.attn.qkv.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.mlp.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.mlp.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.mlp.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.mlp.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.norm1.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.norm1.weight": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.norm2.bias": "model-00001-of-00002.safetensors",
"model.visual.blocks.9.norm2.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.norm.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.0.norm.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.norm.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.1.norm.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.norm.bias": "model-00001-of-00002.safetensors",
"model.visual.deepstack_merger_list.2.norm.weight": "model-00001-of-00002.safetensors",
"model.visual.merger.linear_fc1.bias": "model-00001-of-00002.safetensors",
"model.visual.merger.linear_fc1.weight": "model-00001-of-00002.safetensors",
"model.visual.merger.linear_fc2.bias": "model-00001-of-00002.safetensors",
"model.visual.merger.linear_fc2.weight": "model-00001-of-00002.safetensors",
"model.visual.merger.norm.bias": "model-00001-of-00002.safetensors",
"model.visual.merger.norm.weight": "model-00001-of-00002.safetensors",
"model.visual.patch_embed.proj.bias": "model-00001-of-00002.safetensors",
"model.visual.patch_embed.proj.weight": "model-00001-of-00002.safetensors",
"model.visual.pos_embed.weight": "model-00001-of-00002.safetensors"
}
}

21
preprocessor_config.json Normal file
View File

@@ -0,0 +1,21 @@
{
"size": {
"longest_edge": 16777216,
"shortest_edge": 65536
},
"patch_size": 16,
"temporal_patch_size": 2,
"merge_size": 2,
"image_mean": [
0.5,
0.5,
0.5
],
"image_std": [
0.5,
0.5,
0.5
],
"processor_class": "Qwen3VLProcessor",
"image_processor_type": "Qwen2VLImageProcessorFast"
}

3
tokenizer.json Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a5d85b6dcc535e6b93115a9ef287e6132fdbf30270da6218194ba742261173c7
size 7032403

239
tokenizer_config.json Normal file
View File

File diff suppressed because one or more lines are too long

21
video_preprocessor_config.json Normal file
View File

@@ -0,0 +1,21 @@
{
"size": {
"longest_edge": 25165824,
"shortest_edge": 4096
},
"patch_size": 16,
"temporal_patch_size": 2,
"merge_size": 2,
"image_mean": [
0.5,
0.5,
0.5
],
"image_std": [
0.5,
0.5,
0.5
],
"processor_class": "Qwen3VLProcessor",
"video_processor_type": "Qwen3VLVideoProcessor"
}

BIN
vocab.json (Stored with Git LFS) Normal file
View File

Binary file not shown.