LLM-Research/digital-socrates-13b
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: LLM-Research/digital-socrates-13b
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-03 17:32:13 +08:00
commit 618534df61
16 changed files with 806 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

41
.gitattributes vendored Normal file
View File

@@ -0,0 +1,41 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
pytorch_model-00001-of-00006.bin filter=lfs diff=lfs merge=lfs -text
pytorch_model-00002-of-00006.bin filter=lfs diff=lfs merge=lfs -text
pytorch_model-00003-of-00006.bin filter=lfs diff=lfs merge=lfs -text
pytorch_model-00004-of-00006.bin filter=lfs diff=lfs merge=lfs -text
pytorch_model-00005-of-00006.bin filter=lfs diff=lfs merge=lfs -text
pytorch_model-00006-of-00006.bin filter=lfs diff=lfs merge=lfs -text

264
README.md Normal file
View File

@@ -0,0 +1,264 @@
---
language: en
license: apache-2.0
library_name: transformers
model-index:
- name: digital-socrates-13b
results:
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
num_few_shot: 25
metrics:
- type: acc_norm
value: 58.36
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: HellaSwag (10-Shot)
type: hellaswag
split: validation
args:
num_few_shot: 10
metrics:
- type: acc_norm
value: 80.14
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU (5-Shot)
type: cais/mmlu
config: all
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 57.01
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: TruthfulQA (0-shot)
type: truthful_qa
config: multiple_choice
split: validation
args:
num_few_shot: 0
metrics:
- type: mc2
value: 44.47
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: Winogrande (5-shot)
type: winogrande
config: winogrande_xl
split: validation
args:
num_few_shot: 5
metrics:
- type: acc
value: 74.59
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GSM8k (5-shot)
type: gsm8k
config: main
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 29.49
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=allenai/digital-socrates-13b
name: Open LLM Leaderboard
---
This is the Digital Socrates 13B (DS-13B) model described in our paper: <b>Digital Socrates: Evaluating LLMs through explanation critiques</b> (ACL Anthology link: https://aclanthology.org/2024.acl-long.302, arXiv link: https://arxiv.org/abs/2311.09613).
The less recommended, smaller 7B model can be found at https://huggingface.co/allenai/digital-socrates-7b
The DS-13B model is a fine-tuned version of [Llama-2-13b-Chat](https://huggingface.co/meta-llama/Llama-2-13b-chat), please
review its [guidelines](https://huggingface.co/meta-llama/Llama-2-13b-chat/blob/main/USE_POLICY.md) and
[licensing](https://huggingface.co/meta-llama/Llama-2-13b-chat#model-details) before use.
# What is Digital Socrates?
Digital Socrates is an open-source, automatic explanation-critiquing model. It is useful for revealing insights about student
models by examining their reasoning chains. The use of Digital Socrates allows for nuanced, interpretable automatic
evaluation of explanations without expensive API calls or human annotations.
While LLMs can provide reasoned explanations along with their answers, the nature and
quality of those explanations are still poorly understood. In response, our goal is to define a detailed way of characterizing the
explanation capabilities of modern models and to create a nuanced, interpretable explanation
evaluation tool that can generate such characterizations automatically.
Given a **question** (together with the multiple-choice options and gold answer),
```commandline
When Dennis operates his lawnmower, he notices the engine makes a lot of noise. He also notices that the engine gets very hot. Which best describes the heat and noise generated from the lawnmower?
(A) a change in phase
(B) thermal expansion
(C) an increase in entropy
(D) mechanical advantage
Answer sheet: (C)
```
as well as a student model explanation and answer,
```
1) The question states that the lawnmower engine makes a lot of noise.
2) The question states that the lawnmower engine gets very hot.
3) Noise and heat are both forms of energy.
4) The noise and heat generated from the lawnmower are a result of the conversion of energy from the fuel to mechanical energy.
Answer: (D)
```
Digital Socrates gives a **critique of the model-generated explanation** that provides localized feedback on the
most significant flaw (if any) in the explanation, suggestions to address the identified flaw, as well as a numeric rating indicating the explanation quality:
```
The explanation states or suggests the following:
* Main flaw (standalone statement): "The noise and heat generated from the lawnmower are a result of the conversion of energy from the fuel to mechanical energy."
* Dimension: incorrect_information
Consider these points for revising the explanation:
* General: It's important to understand the difference between the different types of energy. Mechanical energy is the energy of motion, while thermal energy is the energy of heat.
* Specific: In the case of the lawnmower, the noise and heat are not a result of the conversion of energy from the fuel to mechanical energy. The noise is a result of the vibration of the engine, while the heat is a result of the friction and combustion of the fuel.
Explanation score: 2
```
Remarkably, despite being orders of magnitude smaller than GPT-4, our Digital Socrates models are
capable of generating critiques close to GPT-4 critiques in terms of human rating and other
quantitative measures (correlation of explanation scores given and error category matches).
Through quantitative and qualitative analysis, we demonstrate how Digital Socrates is useful for
revealing insights about student models by examining their reasoning chains.
We invite you to try out Digital Socrates for your own application!
# How to use Digital Socrates?
We provide a quick example of how you can try out Digital Socrates with just a few lines of code:
'DSCritiqueBank-V1' used below can be downloaded from our [dataset page](https://allenai.org/data/digital-socrates).
```
import json
from transformers import AutoTokenizer, AutoModelForCausalLM
# Load model and tokenizer
model_path = "allenai/digital-socrates-13b"
model = AutoModelForCausalLM.from_pretrained(model_path, device_map="auto")
tokenizer = AutoTokenizer.from_pretrained(model_path)
# Define input data
question = "When Dennis operates his lawnmower, he notices the engine makes a lot of noise. He also notices that the engine gets very hot. Which best describes the heat and noise generated from the lawnmower? (A) a change in phase (B) thermal expansion (C) an increase in entropy (D) mechanical advantage"
explanation = "1) The question states that the lawnmower engine makes a lot of noise.\n2) The question states that the lawnmower engine gets very hot.\n3) Noise and heat are both forms of energy.\n4) The noise and heat generated from the lawnmower are a result of the conversion of energy from the fuel to mechanical energy."
answerkey = "C"
predictedanswer = "D"
# construct prompt (Llama conventions)
with open("../DSCritiqueBank-V1/DSCB-prompts.json") as file:
prompts = json.load(file)
system_prompt = prompts['digital_socrates_v1']['system']
user_prompt = prompts['digital_socrates_v1']['main'].replace("[[QUESTION]]", question).replace("[[EXPLANATION]]", explanation).replace("[[PREDICTEDANSWER]]", predictedanswer).replace("[[ANSWERKEY]]", answerkey)
full_prompt = f"[INST] <<SYS>>\n{system_prompt}\n<</SYS>{user_prompt} [/INST]\n\n"
# Run model
input_ids = tokenizer.encode(full_prompt, return_tensors="pt").to("cuda:0")
output = model.generate(input_ids, max_new_tokens=512, temperature=0)
res = tokenizer.batch_decode(output, skip_special_tokens=True)
```
Print the output:
```
>>> print(res[0].split("[/INST]")[-1])
The explanation states or suggests the following:
* Main flaw (standalone statement): "The noise and heat generated from the lawnmower are a result of the conversion of energy from the fuel to mechanical energy."
* Dimension: incorrect_information
Consider these points for revising the explanation:
* General: It's important to understand the difference between the different types of energy. Mechanical energy is the energy of motion, while thermal energy is the energy of heat.
* Specific: In the case of the lawnmower, the noise and heat are not a result of the conversion of energy from the fuel to mechanical energy. The noise is a result of the vibration of the engine, while the heat is a result of the friction and combustion of the fuel.
Explanation score: 2
```
# More details about Digital Socrates ...
For more details about Digital Socrates, please refer to our:
* 📄Paper: https://arxiv.org/abs/2311.09613
* 💻Dataset: https://allenai.org/data/digital-socrates
# Citation
```
@inproceedings{gu-etal-2024-digital,
title = "Digital Socrates: Evaluating {LLM}s through Explanation Critiques",
author = "Gu, Yuling and
Tafjord, Oyvind and
Clark, Peter",
editor = "Ku, Lun-Wei and
Martins, Andre and
Srikumar, Vivek",
booktitle = "Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
month = aug,
year = "2024",
address = "Bangkok, Thailand",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2024.acl-long.302",
pages = "5559--5586",
}
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_allenai__digital-socrates-13b)
| Metric |Value|
|---------------------------------|----:|
|Avg. |57.34|
|AI2 Reasoning Challenge (25-Shot)|58.36|
|HellaSwag (10-Shot) |80.14|
|MMLU (5-Shot) |57.01|
|TruthfulQA (0-shot) |44.47|
|Winogrande (5-shot) |74.59|
|GSM8k (5-shot) |29.49|

6
added_tokens.json Normal file
View File

@@ -0,0 +1,6 @@
{
"</s>": 2,
"<pad>": 32000,
"<s>": 1,
"<unk>": 0
}

28
config.json Normal file
View File

@@ -0,0 +1,28 @@
{
"_name_or_path": "output/Llama-2-13b-chat-arc-rainbow-train",
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"bos_token_id": 1,
"eos_token_id": 2,
"hidden_act": "silu",
"hidden_size": 5120,
"initializer_range": 0.02,
"intermediate_size": 13824,
"max_position_embeddings": 4096,
"model_type": "llama",
"num_attention_heads": 40,
"num_hidden_layers": 40,
"num_key_value_heads": 40,
"pad_token_id": 0,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_scaling": null,
"rope_theta": 10000.0,
"tie_word_embeddings": false,
"torch_dtype": "float32",
"transformers_version": "4.35.0.dev0",
"use_cache": true,
"vocab_size": 32001
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}

7
generation_config.json Normal file
View File

@@ -0,0 +1,7 @@
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 2,
"pad_token_id": 0,
"transformers_version": "4.35.0.dev0"
}

3
pytorch_model-00001-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7752bee047d052b31bbbafe9ecdd28799c81f83259ff4a86bb80efbb97d3bc21
size 9956559563

3
pytorch_model-00002-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:56da1eadde5028d7a75db703ca4efb2058cc20b5154869f3a33c2db2ae6e3843
size 9940852143

3
pytorch_model-00003-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7717b7100c61f9e0f051606814dc08bde5f9935b0570a1a4c95c99d806898b1c
size 9940852155

3
pytorch_model-00004-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f6cf88b896fd4169ac686c2a4dbf555ea6a2b74fe4426956893bbeb3230e7ef
size 9867410489

3
pytorch_model-00005-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f3005f47ada2edab54e31cafdf928e5082cea0fd51726bac778b36d99e7239d
size 9867452125

3
pytorch_model-00006-of-00006.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:26753daa0f726bb4aa186ec10d0678bf62d8642e8f25c37d14a3809ff129ba54
size 2490496157

370
pytorch_model.bin.index.json Normal file
View File

@@ -0,0 +1,370 @@
{
"metadata": {
"total_size": 52063498240
},
"weight_map": {
"lm_head.weight": "pytorch_model-00006-of-00006.bin",
"model.embed_tokens.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.0.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.1.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.10.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.10.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.11.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.12.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.13.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.14.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.15.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.15.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.15.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.15.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.16.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.17.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.18.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.19.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.2.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.2.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.20.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.20.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.21.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.input_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.mlp.down_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.mlp.gate_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.mlp.up_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.post_attention_layernorm.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.self_attn.k_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.self_attn.o_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.self_attn.q_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.22.self_attn.v_proj.weight": "pytorch_model-00003-of-00006.bin",
"model.layers.23.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.23.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.24.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.25.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.26.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.27.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.28.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.input_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.mlp.down_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.post_attention_layernorm.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.29.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.3.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.3.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.30.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.30.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.30.mlp.gate_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.30.mlp.up_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.30.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.30.self_attn.k_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.30.self_attn.o_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.30.self_attn.q_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.30.self_attn.v_proj.weight": "pytorch_model-00004-of-00006.bin",
"model.layers.31.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.31.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.32.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.33.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.34.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.35.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.36.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.input_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.mlp.down_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.mlp.up_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.post_attention_layernorm.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.37.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.38.input_layernorm.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.38.mlp.down_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.38.mlp.gate_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.38.mlp.up_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.38.post_attention_layernorm.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.38.self_attn.k_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.38.self_attn.o_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.38.self_attn.q_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.38.self_attn.v_proj.weight": "pytorch_model-00005-of-00006.bin",
"model.layers.39.input_layernorm.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.mlp.down_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.mlp.gate_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.mlp.up_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.post_attention_layernorm.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.self_attn.k_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.self_attn.o_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.self_attn.q_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.39.self_attn.v_proj.weight": "pytorch_model-00006-of-00006.bin",
"model.layers.4.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.4.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.5.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.input_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.mlp.down_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.mlp.gate_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.mlp.up_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.post_attention_layernorm.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.6.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.7.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.7.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.7.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.7.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.7.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.7.self_attn.k_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.7.self_attn.o_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.7.self_attn.q_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.7.self_attn.v_proj.weight": "pytorch_model-00001-of-00006.bin",
"model.layers.8.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.8.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.input_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.mlp.down_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.mlp.gate_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.mlp.up_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.post_attention_layernorm.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.self_attn.k_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.self_attn.o_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.self_attn.q_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.layers.9.self_attn.v_proj.weight": "pytorch_model-00002-of-00006.bin",
"model.norm.weight": "pytorch_model-00006-of-00006.bin"
}
}

12
special_tokens_map.json Normal file
View File

@@ -0,0 +1,12 @@
{
"additional_special_tokens": [
"<unk>",
"<s>",
"</s>",
"<pad>"
],
"bos_token": "<s>",
"eos_token": "</s>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}

3
tokenizer.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
size 499723

56
tokenizer_config.json Normal file
View File

@@ -0,0 +1,56 @@
{
"add_bos_token": true,
"add_eos_token": false,
"added_tokens_decoder": {
"0": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"32000": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"<unk>",
"<s>",
"</s>",
"<pad>"
],
"bos_token": "<s>",
"clean_up_tokenization_spaces": false,
"eos_token": "</s>",
"legacy": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<pad>",
"sp_model_kwargs": {},
"spaces_between_special_tokens": false,
"tokenizer_class": "LlamaTokenizer",
"tokenizer_file": null,
"unk_token": "<unk>",
"use_default_system_prompt": false
}