初始化项目，由ModelHub XC社区提供模型
Model: Xtra-Computing/XtraGPT-14B Source: Original Platform
This commit is contained in:
ModelHub XC
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
188
README.md
Normal file
188
README.md
Normal file
@@ -0,0 +1,188 @@
|
||||
---
|
||||
license: other
|
||||
license_name: mg0-2.0
|
||||
license_link: https://github.com/Xtra-Computing/ModelGo/blob/main/MG_licenses/V2/MG0-2.0.txt
|
||||
language:
|
||||
- zho
|
||||
- eng
|
||||
- fra
|
||||
- spa
|
||||
- por
|
||||
- deu
|
||||
- ita
|
||||
- rus
|
||||
- jpn
|
||||
- kor
|
||||
- vie
|
||||
- tha
|
||||
- ara
|
||||
pipeline_tag: text-generation
|
||||
base_model: microsoft/phi-4
|
||||
tags:
|
||||
- chat
|
||||
library_name: transformers
|
||||
---
|
||||
|
||||
# XtraGPT: Context-Aware and Controllable Academic Paper Revision for Human-AI Collaboration
|
||||
|
||||
<p align="center">
|
||||
<a href="https://arxiv.org/abs/2505.11336">
|
||||
<img alt="arXiv" src="https://img.shields.io/badge/arXiv-2505.11336-b31b1b.svg">
|
||||
</a>
|
||||
</p>
|
||||
|
||||
## Model Overview
|
||||
|
||||
**XtraGPT** is a family of open-source Large Language Models (LLMs) designed specifically for **human-AI collaborative academic paper revision**. Unlike general-purpose models that often perform surface-level polishing, XtraGPT is fine-tuned to **understand the full context** of a research paper and execute specific, **criteria-guided** revision instructions.
|
||||
|
||||
The models were trained on a dataset of 140,000 high-quality instruction-revision pairs derived from top-tier conference papers (ICLR).
|
||||
|
||||
**Key Features:**
|
||||
* **Context-Aware:** Processes the full paper context to ensure revisions maintain consistency with the global narrative.
|
||||
* **Controllable:** Follows specific user instructions aligned with 20 academic writing criteria across 6 sections (Abstract, Introduction, etc.).
|
||||
* **Iterative Workflow:** Designed to support the "Human-AI Collaborative" (HAC) lifecycle where authors retain creative control.
|
||||
|
||||
**Available Model Sizes:**
|
||||
* **1.5B** (Based on Qwen/Qwen2.5-1.5B-Instruct)
|
||||
* **3B** (Based on meta-llama/Llama-3.2-3B-Instruct)
|
||||
* **7B** (Based on Qwen/Qwen2.5-7B-Instruct)
|
||||
* **14B** (Based on microsoft/phi-4)
|
||||
|
||||
---
|
||||
|
||||
## Inference with Transformers
|
||||
|
||||
To use XtraGPT with the standard Hugging Face `transformers` library, ensure you format your input using the specific tags `<PAPER_CONTENT>`, `<SELECTED_CONTENT>`, and `<QUESTION>`.
|
||||
|
||||
```python
|
||||
import torch
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
|
||||
# Select the model size: "XtraGPT-1.5B", "XtraGPT-3B", "XtraGPT-7B", or "XtraGPT-14B"
|
||||
model_name = "Xtra-Computing/XtraGPT-7B"
|
||||
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_name)
|
||||
model = AutoModelForCausalLM.from_pretrained(
|
||||
model_name,
|
||||
torch_dtype=torch.float16,
|
||||
device_map="auto"
|
||||
)
|
||||
|
||||
# Define the Prompt Template tailored for XtraGPT
|
||||
prompt_template = """Act as an expert model for improving articles **PAPER_CONTENT**.
|
||||
The output needs to answer the **QUESTION** on **SELECTED_CONTENT** in the input. Avoid adding unnecessary length, unrelated details, overclaims, or vague statements.
|
||||
Focus on clear, concise, and evidence-based improvements that align with the overall context of the paper.
|
||||
<PAPER_CONTENT>
|
||||
{paper_content}
|
||||
</PAPER_CONTENT>
|
||||
<SELECTED_CONTENT>
|
||||
{selected_content}
|
||||
</SELECTED_CONTENT>
|
||||
<QUESTION>
|
||||
{user_question}
|
||||
</QUESTION>"""
|
||||
|
||||
# Example Data (from the "Attention Is All You Need" paper)
|
||||
paper_content = "The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train."
|
||||
selected_content = "The dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration."
|
||||
user_question = "help me make it more concise."
|
||||
|
||||
# Format the input
|
||||
formatted_prompt = prompt_template.format(
|
||||
paper_content=paper_content,
|
||||
selected_content=selected_content,
|
||||
user_question=user_question
|
||||
)
|
||||
|
||||
messages = [
|
||||
{"role": "user", "content": formatted_prompt}
|
||||
]
|
||||
|
||||
# Apply chat template
|
||||
text = tokenizer.apply_chat_template(
|
||||
messages,
|
||||
tokenize=False,
|
||||
add_generation_prompt=True
|
||||
)
|
||||
|
||||
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
|
||||
|
||||
# Generate
|
||||
generated_ids = model.generate(
|
||||
**model_inputs,
|
||||
max_new_tokens=16384,
|
||||
temperature=0.1
|
||||
)
|
||||
|
||||
generated_ids = [
|
||||
output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
|
||||
]
|
||||
|
||||
response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
|
||||
print(response)
|
||||
```
|
||||
|
||||
-----
|
||||
|
||||
## Inference with vLLM
|
||||
|
||||
XtraGPT is compatible with vLLM for high-throughput inference.
|
||||
|
||||
### 1\. Launch the Server
|
||||
|
||||
Replace `XtraGPT-14B` with your specific model variant.
|
||||
|
||||
```bash
|
||||
python -m vllm.entrypoints.openai.api_server \
|
||||
--port 8088 \
|
||||
--model Xtra-Computing/XtraGPT-14B \
|
||||
--served-model-name xtragpt \
|
||||
--max-model-len 16384 \
|
||||
--gpu-memory-utilization 0.95
|
||||
```
|
||||
|
||||
### 2\. Send a Request (Client Side)
|
||||
|
||||
```bash
|
||||
curl [http://127.0.0.1:8088/v1/chat/completions](http://127.0.0.1:8088/v1/chat/completions) \
|
||||
-H "Content-Type: application/json" \
|
||||
-d '{
|
||||
"model": "xtragpt",
|
||||
"messages": [
|
||||
{
|
||||
"role": "user",
|
||||
"content": "Please improve the selected content based on the following. Act as an expert model for improving articles **PAPER_CONTENT**.\nThe output needs to answer the **QUESTION** on **SELECTED_CONTENT** in the input. Avoid adding unnecessary length, unrelated details, overclaims, or vague statements.\nFocus on clear, concise, and evidence-based improvements that align with the overall context of the paper.\n<PAPER_CONTENT>\nThe dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration. The best performing models also connect the encoder and decoder through an attention mechanism. We propose a new simple network architecture, the Transformer, based solely on attention mechanisms, dispensing with recurrence and convolutions entirely. Experiments on two machine translation tasks show these models to be superior in quality while being more parallelizable and requiring significantly less time to train.\n</PAPER_CONTENT>\n<SELECTED_CONTENT>\nThe dominant sequence transduction models are based on complex recurrent or convolutional neural networks in an encoder-decoder configuration.\n</SELECTED_CONTENT>\n<QUESTION>\nhelp me make it more concise.\n</QUESTION>"
|
||||
}
|
||||
],
|
||||
"temperature": 0.1,
|
||||
"max_new_tokens": 16384,
|
||||
"stream": false
|
||||
}'
|
||||
```
|
||||
|
||||
-----
|
||||
|
||||
## Model License
|
||||
|
||||
This model is released under the **ModelGo Zero License 2.0 (MG0-2.0)**.
|
||||
|
||||
MG0-2.0 is a highly permissive open model license designed to facilitate the widest possible adoption and collaboration. It allows for **unrestricted use**, reproduction, distribution, and the creation of derivative works including for commercial purposes, without requiring attribution or imposing copyleft restrictions.
|
||||
|
||||
For more details on the license terms, please visit [ModelGo.li](https://www.modelgo.li/) or refer to the `LICENSE` file in the repository.
|
||||
|
||||
-----
|
||||
|
||||
## Citation
|
||||
|
||||
If you use XtraGPT in your research, please cite our paper:
|
||||
|
||||
```
|
||||
@inproceedings{
|
||||
chen2026xtragpt,
|
||||
title={XtraGPT: Context-Aware and Controllable Academic Paper Revision via Human-AI Collaboration},
|
||||
author={Nuo Chen and Andre Lin HuiKai and Jiaying Wu and Junyi Hou and Zining Zhang and Qian Wang and Xidong Wang and Bingsheng He},
|
||||
booktitle = "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)",
|
||||
year={2026},
|
||||
note={Available on arXiv:2505.11336}
|
||||
}
|
||||
```
|
||||
98
added_tokens.json
Normal file
98
added_tokens.json
Normal file
@@ -0,0 +1,98 @@
|
||||
{
|
||||
"<|dummy_0|>": 100256,
|
||||
"<|endoftext|>": 100257,
|
||||
"<|fim_prefix|>": 100258,
|
||||
"<|fim_middle|>": 100259,
|
||||
"<|fim_suffix|>": 100260,
|
||||
"<|dummy_1|>": 100261,
|
||||
"<|dummy_2|>": 100262,
|
||||
"<|dummy_3|>": 100263,
|
||||
"<|im_start|>": 100264,
|
||||
"<|im_end|>": 100265,
|
||||
"<|im_sep|>": 100266,
|
||||
"<|dummy_4|>": 100267,
|
||||
"<|dummy_5|>": 100268,
|
||||
"<|dummy_6|>": 100269,
|
||||
"<|dummy_7|>": 100270,
|
||||
"<|dummy_8|>": 100271,
|
||||
"<|dummy_9|>": 100272,
|
||||
"<|dummy_10|>": 100273,
|
||||
"<|dummy_11|>": 100274,
|
||||
"<|dummy_12|>": 100275,
|
||||
"<|endofprompt|>": 100276,
|
||||
"<|dummy_13|>": 100277,
|
||||
"<|dummy_14|>": 100278,
|
||||
"<|dummy_15|>": 100279,
|
||||
"<|dummy_16|>": 100280,
|
||||
"<|dummy_17|>": 100281,
|
||||
"<|dummy_18|>": 100282,
|
||||
"<|dummy_19|>": 100283,
|
||||
"<|dummy_20|>": 100284,
|
||||
"<|dummy_21|>": 100285,
|
||||
"<|dummy_22|>": 100286,
|
||||
"<|dummy_23|>": 100287,
|
||||
"<|dummy_24|>": 100288,
|
||||
"<|dummy_25|>": 100289,
|
||||
"<|dummy_26|>": 100290,
|
||||
"<|dummy_27|>": 100291,
|
||||
"<|dummy_28|>": 100292,
|
||||
"<|dummy_29|>": 100293,
|
||||
"<|dummy_30|>": 100294,
|
||||
"<|dummy_31|>": 100295,
|
||||
"<|dummy_32|>": 100296,
|
||||
"<|dummy_33|>": 100297,
|
||||
"<|dummy_34|>": 100298,
|
||||
"<|dummy_35|>": 100299,
|
||||
"<|dummy_36|>": 100300,
|
||||
"<|dummy_37|>": 100301,
|
||||
"<|dummy_38|>": 100302,
|
||||
"<|dummy_39|>": 100303,
|
||||
"<|dummy_40|>": 100304,
|
||||
"<|dummy_41|>": 100305,
|
||||
"<|dummy_42|>": 100306,
|
||||
"<|dummy_43|>": 100307,
|
||||
"<|dummy_44|>": 100308,
|
||||
"<|dummy_45|>": 100309,
|
||||
"<|dummy_46|>": 100310,
|
||||
"<|dummy_47|>": 100311,
|
||||
"<|dummy_48|>": 100312,
|
||||
"<|dummy_49|>": 100313,
|
||||
"<|dummy_50|>": 100314,
|
||||
"<|dummy_51|>": 100315,
|
||||
"<|dummy_52|>": 100316,
|
||||
"<|dummy_53|>": 100317,
|
||||
"<|dummy_54|>": 100318,
|
||||
"<|dummy_55|>": 100319,
|
||||
"<|dummy_56|>": 100320,
|
||||
"<|dummy_57|>": 100321,
|
||||
"<|dummy_58|>": 100322,
|
||||
"<|dummy_59|>": 100323,
|
||||
"<|dummy_60|>": 100324,
|
||||
"<|dummy_61|>": 100325,
|
||||
"<|dummy_62|>": 100326,
|
||||
"<|dummy_63|>": 100327,
|
||||
"<|dummy_64|>": 100328,
|
||||
"<|dummy_65|>": 100329,
|
||||
"<|dummy_66|>": 100330,
|
||||
"<|dummy_67|>": 100331,
|
||||
"<|dummy_68|>": 100332,
|
||||
"<|dummy_69|>": 100333,
|
||||
"<|dummy_70|>": 100334,
|
||||
"<|dummy_71|>": 100335,
|
||||
"<|dummy_72|>": 100336,
|
||||
"<|dummy_73|>": 100337,
|
||||
"<|dummy_74|>": 100338,
|
||||
"<|dummy_75|>": 100339,
|
||||
"<|dummy_76|>": 100340,
|
||||
"<|dummy_77|>": 100341,
|
||||
"<|dummy_78|>": 100342,
|
||||
"<|dummy_79|>": 100343,
|
||||
"<|dummy_80|>": 100344,
|
||||
"<|dummy_81|>": 100345,
|
||||
"<|dummy_82|>": 100346,
|
||||
"<|dummy_83|>": 100347,
|
||||
"<|dummy_84|>": 100348,
|
||||
"<|dummy_85|>": 100349,
|
||||
"<|dummy_86|>": 100350,
|
||||
"<|dummy_87|>": 100351
|
||||
}
|
||||
1
chat_template.jinja
Normal file
1
chat_template.jinja
Normal file
@@ -0,0 +1 @@
|
||||
{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}
|
||||
37
config.json
Normal file
37
config.json
Normal file
@@ -0,0 +1,37 @@
|
||||
{
|
||||
"_name_or_path": "microsoft/phi-4",
|
||||
"architectures": [
|
||||
"Phi3ForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"auto_map": {},
|
||||
"bos_token_id": 100257,
|
||||
"dtype": "bfloat16",
|
||||
"embd_pdrop": 0.0,
|
||||
"eos_token_id": 100265,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 5120,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 17920,
|
||||
"max_position_embeddings": 16384,
|
||||
"model_type": "phi3",
|
||||
"num_attention_heads": 40,
|
||||
"num_hidden_layers": 40,
|
||||
"num_key_value_heads": 10,
|
||||
"original_max_position_embeddings": 16384,
|
||||
"pad_token_id": 100349,
|
||||
"partial_rotary_factor": 1.0,
|
||||
"resid_pdrop": 0.0,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_parameters": {
|
||||
"partial_rotary_factor": 1.0,
|
||||
"rope_theta": 250000,
|
||||
"rope_type": "default"
|
||||
},
|
||||
"sliding_window": null,
|
||||
"tie_word_embeddings": false,
|
||||
"transformers_version": "5.7.0",
|
||||
"use_cache": false,
|
||||
"vocab_size": 100352
|
||||
}
|
||||
9
generation_config.json
Normal file
9
generation_config.json
Normal file
@@ -0,0 +1,9 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 100257,
|
||||
"eos_token_id": [
|
||||
100265
|
||||
],
|
||||
"pad_token_id": 100349,
|
||||
"transformers_version": "5.7.0"
|
||||
}
|
||||
100001
merges.txt
Normal file
100001
merges.txt
Normal file
File diff suppressed because it is too large
Load Diff
3
model-00001-of-00007.safetensors
Normal file
3
model-00001-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ca3c299a4994aa615237b33ea19a5857a6dabe1d2a2772c58e75199fa2197843
|
||||
size 4965102784
|
||||
3
model-00002-of-00007.safetensors
Normal file
3
model-00002-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:053a7dbb7d3efde94de77d07a3afb0ed32ee0d7786f7863797cc006e5c4c6ecf
|
||||
size 4771169080
|
||||
3
model-00003-of-00007.safetensors
Normal file
3
model-00003-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:101803b6e19a00095501536e8f49a106838196bc9e3c04a06f7d416b82897bc9
|
||||
size 4771169128
|
||||
3
model-00004-of-00007.safetensors
Normal file
3
model-00004-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:dc22cb1ec92b3a28b36cb1e6f353f9b922be58645ed7e5611b771bc6c0b68dab
|
||||
size 4771169128
|
||||
3
model-00005-of-00007.safetensors
Normal file
3
model-00005-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3243d229368ddce53aa9362fe5cfc15b30d2514a0ea1d4821fd97de3b0b8563a
|
||||
size 4771169128
|
||||
3
model-00006-of-00007.safetensors
Normal file
3
model-00006-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:36f211e90306b5dd6c2e1eb583240e87a2f4862e89ffe38e3b6e22d4e45d2c43
|
||||
size 4771169128
|
||||
3
model-00007-of-00007.safetensors
Normal file
3
model-00007-of-00007.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:476968789443a6031a6d84d98ee9ea53503f430814ccc977de5d39ee9f90f66a
|
||||
size 498094672
|
||||
251
model.safetensors.index.json
Normal file
251
model.safetensors.index.json
Normal file
@@ -0,0 +1,251 @@
|
||||
{
|
||||
"metadata": {
|
||||
"total_parameters": 14659507200,
|
||||
"total_size": 29319014400
|
||||
},
|
||||
"weight_map": {
|
||||
"lm_head.weight": "model-00001-of-00007.safetensors",
|
||||
"model.embed_tokens.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.input_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.mlp.gate_up_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.0.self_attn.qkv_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.input_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.mlp.gate_up_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.1.self_attn.qkv_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.10.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.10.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.10.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.10.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.10.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.11.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.11.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.11.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.11.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.11.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.12.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.13.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.14.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.15.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.16.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.mlp.gate_up_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.post_attention_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.17.self_attn.qkv_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.18.input_layernorm.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.18.mlp.down_proj.weight": "model-00003-of-00007.safetensors",
|
||||
"model.layers.18.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.18.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.18.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.19.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.2.input_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.2.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.2.mlp.gate_up_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.2.self_attn.qkv_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.20.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.20.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.20.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.20.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.20.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.21.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.22.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.23.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.mlp.gate_up_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.post_attention_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.24.self_attn.qkv_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.25.input_layernorm.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.25.mlp.down_proj.weight": "model-00004-of-00007.safetensors",
|
||||
"model.layers.25.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.25.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.25.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.26.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.27.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.28.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.29.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.3.input_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.3.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.3.mlp.gate_up_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.3.post_attention_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.3.self_attn.qkv_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.30.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.30.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.30.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.30.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.30.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.mlp.gate_up_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.post_attention_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.31.self_attn.qkv_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.32.input_layernorm.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.32.mlp.down_proj.weight": "model-00005-of-00007.safetensors",
|
||||
"model.layers.32.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.32.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.32.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.33.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.34.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.35.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.36.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.37.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.mlp.gate_up_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.post_attention_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.38.self_attn.qkv_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.39.input_layernorm.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.39.mlp.down_proj.weight": "model-00006-of-00007.safetensors",
|
||||
"model.layers.39.mlp.gate_up_proj.weight": "model-00007-of-00007.safetensors",
|
||||
"model.layers.39.post_attention_layernorm.weight": "model-00007-of-00007.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.weight": "model-00007-of-00007.safetensors",
|
||||
"model.layers.39.self_attn.qkv_proj.weight": "model-00007-of-00007.safetensors",
|
||||
"model.layers.4.input_layernorm.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.4.mlp.down_proj.weight": "model-00001-of-00007.safetensors",
|
||||
"model.layers.4.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.4.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.4.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.5.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.6.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.7.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.8.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.input_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.mlp.down_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.mlp.gate_up_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.post_attention_layernorm.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.layers.9.self_attn.qkv_proj.weight": "model-00002-of-00007.safetensors",
|
||||
"model.norm.weight": "model-00007-of-00007.safetensors"
|
||||
}
|
||||
}
|
||||
5
special_tokens_map.json
Normal file
5
special_tokens_map.json
Normal file
@@ -0,0 +1,5 @@
|
||||
{
|
||||
"bos_token": "<|endoftext|>",
|
||||
"eos_token": "<|im_end|>",
|
||||
"pad_token": "<|dummy_85|>"
|
||||
}
|
||||
501289
tokenizer.json
Normal file
501289
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
14
tokenizer_config.json
Normal file
14
tokenizer_config.json
Normal file
@@ -0,0 +1,14 @@
|
||||
{
|
||||
"add_prefix_space": false,
|
||||
"backend": "tokenizers",
|
||||
"bos_token": "<|endoftext|>",
|
||||
"clean_up_tokenization_spaces": false,
|
||||
"eos_token": "<|im_end|>",
|
||||
"is_local": true,
|
||||
"local_files_only": false,
|
||||
"model_max_length": 16384,
|
||||
"pad_token": "<|dummy_85|>",
|
||||
"padding_side": "right",
|
||||
"split_special_tokens": false,
|
||||
"tokenizer_class": "TokenizersBackend"
|
||||
}
|
||||
1
vocab.json
Normal file
1
vocab.json
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user