初始化项目,由ModelHub XC社区提供模型

Model: facebook/galactica-30b
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-20 02:01:05 +08:00
commit e564db2c26
15 changed files with 101051 additions and 0 deletions

34
.gitattributes vendored Normal file
View File

@@ -0,0 +1,34 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

176
README.md Normal file
View File

@@ -0,0 +1,176 @@
---
license: cc-by-nc-4.0
tags:
- galactica
widget:
- text: "The Transformer architecture [START_REF]"
- text: "The Schwarzschild radius is defined as: \\["
- text: "A force of 0.6N is applied to an object, which accelerates at 3m/s. What is its mass? <work>"
- text: "Lecture 1: The Ising Model\n\n"
- text: "[START_I_SMILES]"
- text: "[START_AMINO]GHMQSITAGQKVISKHKNGRFYQCEVVRLTTETFYEVNFDDGSFSDNLYPEDIVSQDCLQFGPPAEGEVVQVRWTDGQVYGAKFVASHPIQMYQVEFEDGSQLVVKRDDVYTLDEELP[END_AMINO] ## Keywords"
inference: false
---
![logo](https://s3.amazonaws.com/moonup/production/uploads/1668679814649-62441d1d9fdefb55a0b7d12c.png)
# GALACTICA 30 B (large)
Model card from the original [repo](https://github.com/paperswithcode/galai/blob/main/docs/model_card.md)
Following [Mitchell et al. (2018)](https://arxiv.org/abs/1810.03993), this model card provides information about the GALACTICA model, how it was trained, and the intended use cases. Full details about how the model was trained and evaluated can be found in the [release paper](https://galactica.org/paper.pdf).
## Model Details
The GALACTICA models are trained on a large-scale scientific corpus. The models are designed to perform scientific tasks, including but not limited to citation prediction, scientific QA, mathematical reasoning, summarization, document generation, molecular property prediction and entity extraction. The models were developed by the Papers with Code team at Meta AI to study the use of language models for the automatic organization of science. We train models with sizes ranging from 125M to 120B parameters. Below is a summary of the released models:
| Size | Parameters |
|:-----------:|:-----------:|
| `mini` | 125 M |
| `base` | 1.3 B |
| `standard` | 6.7 B |
| `large` | 30 B |
| `huge` | 120 B |
## Release Date
November 2022
## Model Type
Transformer based architecture in a decoder-only setup with a few modifications (see paper for more details).
## Paper & Demo
[Paper](https://galactica.org/paper.pdf) / [Demo](https://galactica.org)
## Model Use
The primary intended users of the GALACTICA models are researchers studying language models applied to the scientific domain. We also anticipate the model will be useful for developers who wish to build scientific tooling. However, we caution against production use without safeguards given the potential of language models to hallucinate.
The models are made available under a non-commercial CC BY-NC 4.0 license. More information about how to use the model can be found in the README.md of this repository.
## Training Data
The GALACTICA models are trained on 106 billion tokens of open-access scientific text and data. This includes papers, textbooks, scientific websites, encyclopedias, reference material, knowledge bases, and more. We tokenize different modalities to provide a natural langauge interface for different tasks. See the README.md for more information. See the paper for full information on the training data.
## How to use
Find below some example scripts on how to use the model in `transformers`:
## Using the Pytorch model
### Running the model on a CPU
<details>
<summary> Click to expand </summary>
```python
from transformers import AutoTokenizer, OPTForCausalLM
tokenizer = AutoTokenizer.from_pretrained("facebook/galactica-30b")
model = OPTForCausalLM.from_pretrained("facebook/galactica-30b")
input_text = "The Transformer architecture [START_REF]"
input_ids = tokenizer(input_text, return_tensors="pt").input_ids
outputs = model.generate(input_ids)
print(tokenizer.decode(outputs[0]))
```
</details>
### Running the model on a GPU
<details>
<summary> Click to expand </summary>
```python
# pip install accelerate
from transformers import AutoTokenizer, OPTForCausalLM
tokenizer = AutoTokenizer.from_pretrained("facebook/galactica-30b")
model = OPTForCausalLM.from_pretrained("facebook/galactica-30b", device_map="auto")
input_text = "The Transformer architecture [START_REF]"
input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
outputs = model.generate(input_ids)
print(tokenizer.decode(outputs[0]))
```
</details>
### Running the model on a GPU using different precisions
#### FP16
<details>
<summary> Click to expand </summary>
```python
# pip install accelerate
import torch
from transformers import AutoTokenizer, OPTForCausalLM
tokenizer = AutoTokenizer.from_pretrained("facebook/galactica-30b")
model = OPTForCausalLM.from_pretrained("facebook/galactica-30b", device_map="auto", torch_dtype=torch.float16)
input_text = "The Transformer architecture [START_REF]"
input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
outputs = model.generate(input_ids)
print(tokenizer.decode(outputs[0]))
```
</details>
#### INT8
<details>
<summary> Click to expand </summary>
```python
# pip install bitsandbytes accelerate
from transformers import AutoTokenizer, OPTForCausalLM
tokenizer = AutoTokenizer.from_pretrained("facebook/galactica-30b")
model = OPTForCausalLM.from_pretrained("facebook/galactica-30b", device_map="auto", load_in_8bit=True)
input_text = "The Transformer architecture [START_REF]"
input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to("cuda")
outputs = model.generate(input_ids)
print(tokenizer.decode(outputs[0]))
```
</details>
## Performance and Limitations
The model outperforms several existing language models on a range of knowledge probes, reasoning, and knowledge-intensive scientific tasks. This also extends to general NLP tasks, where GALACTICA outperforms other open source general language models. That being said, we note a number of limitations in this section.
As with other language models, GALACTICA is often prone to hallucination - and training on a high-quality academic corpus does not prevent this, especially for less popular and less cited scientific concepts. There are no guarantees of truthful output when generating from the model. This extends to specific modalities such as citation prediction. While GALACTICA's citation behaviour approaches the ground truth citation behaviour with scale, the model continues to exhibit a popularity bias at larger scales.
In addition, we evaluated the model on several types of benchmarks related to stereotypes and toxicity. Overall, the model exhibits substantially lower toxicity rates compared to other large language models. That being said, the model continues to exhibit bias on certain measures (see the paper for details). So we recommend care when using the model for generations.
## Broader Implications
GALACTICA can potentially be used as a new way to discover academic literature. We also expect a lot of downstream use for application to particular domains, such as mathematics, biology, and chemistry. In the paper, we demonstrated several examples of the model acting as alternative to standard search tools. We expect a new generation of scientific tools to be built upon large language models such as GALACTICA.
We encourage researchers to investigate beneficial and new use cases for these models. That being said, it is important to be aware of the current limitations of large language models. Researchers should pay attention to common issues such as hallucination and biases that could emerge from using these models.
## Citation
```bibtex
@inproceedings{GALACTICA,
title={GALACTICA: A Large Language Model for Science},
author={Ross Taylor and Marcin Kardas and Guillem Cucurull and Thomas Scialom and Anthony Hartshorn and Elvis Saravia and Andrew Poulton and Viktor Kerkez and Robert Stojnic},
year={2022}
}
```

31
config.json Normal file
View File

@@ -0,0 +1,31 @@
{
"_remove_final_layer_norm": false,
"activation_dropout": 0.0,
"activation_function": "gelu",
"architectures": [
"OPTForCausalLM"
],
"attention_dropout": 0.1,
"enable_bias": true,
"bos_token_id": 0,
"do_layer_norm_before": true,
"dropout": 0.1,
"eos_token_id": 2,
"ffn_dim": 28672,
"hidden_size": 7168,
"init_std": 0.02,
"layer_norm_elementwise_affine": true,
"layerdrop": 0.0,
"learned_embeddings": true,
"max_position_embeddings": 2048,
"model_type": "opt",
"num_attention_heads": 56,
"num_hidden_layers": 48,
"pad_token_id": 1,
"scale_embeddings": false,
"torch_dtype": "float16",
"transformers_version": "4.21.0.dev0",
"use_cache": true,
"vocab_size": 50000,
"word_embed_proj_dim": 7168
}

7
generation_config.json Normal file
View File

@@ -0,0 +1,7 @@
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": 2,
"pad_token_id": 1,
"transformers_version": "4.27.0.dev0"
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:deb205287c0b95b6cd12508994ea5ecc4aa6291bc0abfc7b0ef1de434c7f1c24
size 9790570949

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7c44ec1aafe99448fd6f89d85c1e686a19f045a18399e4f4161191b14d756ef
size 9866538155

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6553abdc4f32588be38944b889e710e924c51ae511b2ae3558835e57d2c506f7
size 9866538219

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8605d4b83a9b0d41a084c8328d78141de776dc56f750a77c9991295460a49fdc
size 9866538219

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5465c9ddce18821e67e5fbabf3c8e7e6f746a1952ecbd175e6d5d4132e41e0e3
size 9866538219

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:547868f116637febb71438f2fb5db63fe640d067cecc958c76aba7bf405d3b66
size 9866538219

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e77a69c7dbc7d17a3c4bc427d93a83f8a226c1f3c0c4a2a50fe5a74d5aa18f21
size 1538986704

View File

@@ -0,0 +1,780 @@
{
"metadata": {
"total_size": 60661981184
},
"weight_map": {
"lm_head.weight": "pytorch_model-00007-of-00007.bin",
"model.decoder.embed_positions.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.embed_tokens.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.0.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.1.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.10.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.10.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.11.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.12.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.13.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.14.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.15.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.15.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.16.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.16.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.17.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.18.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.19.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.2.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.2.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.20.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.20.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.21.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.fc1.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.fc1.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.fc2.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.fc2.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.final_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.final_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.22.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.23.self_attn.k_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.k_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.out_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.out_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.q_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.q_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.v_proj.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn.v_proj.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn_layer_norm.bias": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.23.self_attn_layer_norm.weight": "pytorch_model-00003-of-00007.bin",
"model.decoder.layers.24.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.24.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.25.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.26.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.27.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.28.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.29.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.3.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.3.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.30.fc1.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.fc1.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.fc2.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.fc2.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.final_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.final_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.30.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.31.self_attn.k_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.k_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.out_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.out_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.q_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.q_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.v_proj.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn.v_proj.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn_layer_norm.bias": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.31.self_attn_layer_norm.weight": "pytorch_model-00004-of-00007.bin",
"model.decoder.layers.32.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.32.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.33.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.34.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.35.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.36.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.37.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.fc1.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.fc1.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.fc2.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.fc2.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.final_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.final_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.38.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.39.self_attn.k_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.k_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.out_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.out_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.q_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.q_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.v_proj.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn.v_proj.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn_layer_norm.bias": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.39.self_attn_layer_norm.weight": "pytorch_model-00005-of-00007.bin",
"model.decoder.layers.4.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.4.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.40.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.40.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.41.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.42.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.43.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.44.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.45.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.fc1.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.fc1.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.fc2.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.fc2.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.final_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.final_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.46.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.fc1.bias": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.fc1.weight": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.fc2.bias": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.fc2.weight": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.final_layer_norm.bias": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.final_layer_norm.weight": "pytorch_model-00007-of-00007.bin",
"model.decoder.layers.47.self_attn.k_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.k_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.out_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.out_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.q_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.q_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.v_proj.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn.v_proj.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn_layer_norm.bias": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.47.self_attn_layer_norm.weight": "pytorch_model-00006-of-00007.bin",
"model.decoder.layers.5.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.5.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.fc1.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.fc1.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.fc2.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.fc2.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.final_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.final_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.6.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.7.self_attn.k_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.k_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.out_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.out_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.q_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.q_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.v_proj.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn.v_proj.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn_layer_norm.bias": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.7.self_attn_layer_norm.weight": "pytorch_model-00001-of-00007.bin",
"model.decoder.layers.8.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.8.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.fc1.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.fc1.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.fc2.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.fc2.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.final_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.final_layer_norm.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.k_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.k_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.out_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.out_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.q_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.q_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.v_proj.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn.v_proj.weight": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn_layer_norm.bias": "pytorch_model-00002-of-00007.bin",
"model.decoder.layers.9.self_attn_layer_norm.weight": "pytorch_model-00002-of-00007.bin"
}
}

1
special_tokens_map.json Normal file
View File

@@ -0,0 +1 @@
{}

99996
tokenizer.json Normal file

File diff suppressed because it is too large Load Diff

5
tokenizer_config.json Normal file
View File

@@ -0,0 +1,5 @@
{
"name_or_path": "/content/tokenizer",
"special_tokens_map_file": "/content/tokenizer/special_tokens_map.json",
"tokenizer_class": "PreTrainedTokenizerFast"
}