初始化项目，由ModelHub XC社区提供模型
Model: isaacus/open-australian-legal-llm Source: Original Platform
This commit is contained in:
ModelHub XC
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
138
README.md
Normal file
138
README.md
Normal file
@@ -0,0 +1,138 @@
|
||||
---
|
||||
language:
|
||||
- en
|
||||
license: apache-2.0
|
||||
library_name: transformers
|
||||
base_model: gpt2-xl
|
||||
tags:
|
||||
- law
|
||||
- legal
|
||||
- australia
|
||||
- generated_from_trainer
|
||||
datasets:
|
||||
- umarbutler/open-australian-legal-corpus
|
||||
widget:
|
||||
- text: 'Under the Crimes Act'
|
||||
- text: 'A restraint of trade is'
|
||||
- text: 'Section 51 of the Constitution provides'
|
||||
- text: "'Unsatisfactory professional conduct' includes"
|
||||
metrics:
|
||||
- perplexity
|
||||
model-index:
|
||||
- name: open-australian-legal-llm
|
||||
results:
|
||||
- task:
|
||||
type: text-generation
|
||||
name: Text generation
|
||||
dataset:
|
||||
type: umarbutler/open-australian-legal-qa
|
||||
name: Open Australian Legal QA
|
||||
split: train
|
||||
revision: b53a24f8edf5eb33d033a53b5b53d0a4a220d4ae
|
||||
metrics:
|
||||
- type: perplexity
|
||||
value: 8.015031389864035
|
||||
name: Perplexity
|
||||
source:
|
||||
name: lmppl
|
||||
url: https://github.com/asahi417/lmppl
|
||||
---
|
||||
|
||||
# Open Australian Legal LLM ⚖️
|
||||
The Open Australian Legal LLM is the largest open source language model trained on Australian law.
|
||||
|
||||
With over 1.5 billion parameters, the model's size and the richness and quality of its training data, comprising roughly 70,000 laws, regulations and decisions across six Australian jurisdictions from the [Open Australian Legal Corpus](https://huggingface.co/datasets/umarbutler/open-australian-legal-corpus), make it well suited for finetuning on a diverse range of downstream natural language processing tasks applied to the Australian legal domain, including text generation, text completion and question answering.
|
||||
|
||||
To ensure its accessibility to as wide an audience as possible, the model is issued under the [Apache Licence 2.0](https://www.apache.org/licenses/LICENSE-2.0.html).
|
||||
|
||||
## Usage 👩💻
|
||||
The code snippet below demonstrates just one of the many ways in which the model may be accessed:
|
||||
```python
|
||||
>>> from transformers import pipeline, set_seed
|
||||
|
||||
>>> set_seed(42) # We set a seed for reproducibility.
|
||||
>>> generator = pipeline('text-generation', model='umarbutler/open-australian-legal-llm')
|
||||
|
||||
>>> response = generator('Section 51 of the Constitution provides', max_length=55)
|
||||
>>> print(response[0]['generated_text'])
|
||||
```
|
||||
|
||||
## Creation 🧪
|
||||
The following cleaning procedures were applied to all 218,340 laws, regulations and decisions in version 4.2.0 of the [Open Australian Legal Corpus](https://huggingface.co/datasets/umarbutler/open-australian-legal-corpus):
|
||||
1. Non-breaking spaces were replaced with regular spaces;
|
||||
1. Return carriages followed by newlines were replaced with newlines;
|
||||
1. Whitespace was removed from lines comprised entirely of whitespace;
|
||||
1. Newlines and whitespace preceding newlines were removed from the end of texts;
|
||||
1. Newlines and whitespace succeeding newlines were removed from the beginning of texts; and
|
||||
1. Spaces and tabs were removed from the end of lines.
|
||||
|
||||
After cleaning, texts with less than 128 characters and those with duplicate XXH3 128-bit hashes were removed, leaving 218,207 documents. These documents were then used to pretrain a [GPT2](https://huggingface.co/gpt2-xl)-like tokenizer, after which they were split into blocks 512-tokens-long, with the tokenizer's end-of-sequence token ('<|endoftext|>') being used as a delimiter as well as to pad the end of the final block. An attention mask was applied to the end-of-sequence tokens used as padding, barring the first such token. The resulting blocks were subsequently randomly shuffled and split into a training dataset of 1,966,867 chunks and a validation dataset of 218,541.
|
||||
|
||||
[GPT2-XL](https://huggingface.co/gpt2-xl) was used as a base model. Input embeddings for tokens shared between the vocabulary trained on the Corpus and that of [GPT2](https://huggingface.co/gpt2-xl) were preserved but moved to their new positions. Embeddings for unique tokens were set to the average embedding weights.
|
||||
|
||||
The model was trained with the following hyperparameters for the first 100,290 steps:
|
||||
| Hyperparameter | Value |
|
||||
| --- | --- |
|
||||
| Sequence length | 512 |
|
||||
| Epochs | 1 |
|
||||
| Optimiser | AdamW |
|
||||
| Learning rate | 1e-4 |
|
||||
| Learning rate scheduler | Linear with warmup |
|
||||
| Batch size | 6 |
|
||||
| Weight decay | 0.01 |
|
||||
| Warmup ratio | 0.06 |
|
||||
|
||||
After training on two RTX A6000s for \~120,050 steps over a period of 91 hours, the [vast.ai](https://vast.ai) instance hosting the model crashed. Fortunately, a checkpoint had been saved at step 100,290 (\~60% of an epoch), although the optimiser's state was mistakenly not downloaded. The model was subsequently moved to a new instance where it was trained on an L40 for a further 133,711 steps (\~40% of an epoch) with the following hyperparameters (changes emphasised):
|
||||
| Hyperparameter | Value |
|
||||
| --- | --- |
|
||||
| Sequence length | 512 |
|
||||
| Epochs | 1 |
|
||||
| Optimiser | AdamW |
|
||||
| Learning rate | *4.255e-5* |
|
||||
| Learning rate scheduler | *Linear* |
|
||||
| Batch size | *3* |
|
||||
| Weight decay | 0.01 |
|
||||
| Warmup ratio | *0.00* |
|
||||
|
||||
Naturally, as the optimiser state had been lost, the model's learning rate descended slower than it had been previously. Nevertheless, after completing an epoch of training, the model was able to achieve a validation loss of 2.04.
|
||||
|
||||
## Benchmarks 📊
|
||||
Tested against version 2.0.0 of the [Open Australian Legal QA](https://huggingface.co/datasets/umarbutler/open-australian-legal-qa) dataset, the model achieved a perplexity of 8.01, outperforming all known language models for Australian law.
|
||||
| Model | Parameters | Perplexity |
|
||||
|--|--|--|
|
||||
| **Open Australian Legal LLM** | **1.5B** | **8.01** |
|
||||
| [Open Australian Legal Phi 1.5](https://huggingface.co/umarbutler/open-australian-legal-phi-1_5) | 1.3B | 8.69 |
|
||||
| [Open Australian Legal GPT2](https://huggingface.co/umarbutler/open-australian-legal-gpt2) | 124M | 16.37 |
|
||||
| [Open Australian Legal DistilGPT2](https://huggingface.co/umarbutler/open-australian-legal-distilgpt2) | 88.2M | 23.9 |
|
||||
|
||||
## Limitations 🚧
|
||||
Although the model has not been tested for bias, one would expect it to exhibit much of the same, if not all, the biases of [GPT2-XL](https://huggingface.co/gpt2-xl).
|
||||
|
||||
One might also expect the model to exhibit a bias towards the type of language employed in laws, regulations and decisions (its source material) as well as towards Commonwealth and New South Wales law (the largest sources of documents in the [Open Australian Legal Corpus](https://huggingface.co/datasets/umarbutler/open-australian-legal-corpus) at the time of the model's creation).
|
||||
|
||||
Finally, it is worth noting that the model may lack knowledge of Victorian, Northern Territory and Australian Capital Territory law as licensing restrictions had prevented their inclusion in the training data.
|
||||
|
||||
## Licence 📜
|
||||
To ensure its accessibility to as wide an audience as possible, the model is issued under the [Apache Licence 2.0](https://www.apache.org/licenses/LICENSE-2.0.html).
|
||||
|
||||
## Citation 🔖
|
||||
If you've relied on the model for your work, please cite:
|
||||
```bibtex
|
||||
@misc{butler-2023-open-australian-legal-llm,
|
||||
author = {Butler, Umar},
|
||||
year = {2023},
|
||||
title = {Open Australian Legal LLM},
|
||||
publisher = {Hugging Face},
|
||||
version = {1.0.0},
|
||||
url = {https://huggingface.co/datasets/umarbutler/open-australian-legal-llm}
|
||||
}
|
||||
```
|
||||
|
||||
## Acknowledgements 🙏
|
||||
In the spirit of reconciliation, the author acknowledges the Traditional Custodians of Country throughout Australia and their connections to land, sea and community. He pays his respect to their Elders past and present and extends that respect to all Aboriginal and Torres Strait Islander peoples today.
|
||||
|
||||
The author thanks the sources of the [Open Australian Legal Corpus](https://huggingface.co/datasets/umarbutler/open-australian-legal-corpus) for making their data available under open licences.
|
||||
|
||||
The author also acknowledges the developers of the many Python libraries relied upon in the training of the model, as well as the makers of [GPT2](https://huggingface.co/gpt2-xl), which the model was built atop.
|
||||
|
||||
Finally, the author is eternally grateful for the endless support of his wife and her willingness to put up with many a late night spent writing code and quashing bugs.
|
||||
40
config.json
Normal file
40
config.json
Normal file
@@ -0,0 +1,40 @@
|
||||
{
|
||||
"_name_or_path": "gpt2-xl",
|
||||
"activation_function": "gelu_new",
|
||||
"architectures": [
|
||||
"GPT2LMHeadModel"
|
||||
],
|
||||
"attn_pdrop": 0.1,
|
||||
"bos_token_id": 0,
|
||||
"embd_pdrop": 0.1,
|
||||
"eos_token_id": 0,
|
||||
"initializer_range": 0.02,
|
||||
"layer_norm_epsilon": 1e-05,
|
||||
"model_type": "gpt2",
|
||||
"n_ctx": 512,
|
||||
"n_embd": 1600,
|
||||
"n_head": 25,
|
||||
"n_inner": null,
|
||||
"n_layer": 48,
|
||||
"n_positions": 1024,
|
||||
"output_past": true,
|
||||
"reorder_and_upcast_attn": false,
|
||||
"resid_pdrop": 0.1,
|
||||
"scale_attn_by_inverse_layer_idx": false,
|
||||
"scale_attn_weights": true,
|
||||
"summary_activation": null,
|
||||
"summary_first_dropout": 0.1,
|
||||
"summary_proj_to_labels": true,
|
||||
"summary_type": "cls_index",
|
||||
"summary_use_proj": true,
|
||||
"task_specific_params": {
|
||||
"text-generation": {
|
||||
"do_sample": true,
|
||||
"max_length": 50
|
||||
}
|
||||
},
|
||||
"torch_dtype": "float32",
|
||||
"transformers_version": "4.36.0",
|
||||
"use_cache": true,
|
||||
"vocab_size": 50257
|
||||
}
|
||||
6
generation_config.json
Normal file
6
generation_config.json
Normal file
@@ -0,0 +1,6 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 0,
|
||||
"eos_token_id": 0,
|
||||
"transformers_version": "4.36.0"
|
||||
}
|
||||
50001
merges.txt
Normal file
50001
merges.txt
Normal file
File diff suppressed because it is too large
Load Diff
3
model-00001-of-00002.safetensors
Normal file
3
model-00001-of-00002.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:335a08824f018b7ceebf8109bd863b3e528cff518701790f18ce4bf8c8a6f506
|
||||
size 4959881464
|
||||
3
model-00002-of-00002.safetensors
Normal file
3
model-00002-of-00002.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5327c7cd9fe928ef3f741d0394530c352452367aaba1215387c339f985bfefb2
|
||||
size 1270624096
|
||||
587
model.safetensors.index.json
Normal file
587
model.safetensors.index.json
Normal file
@@ -0,0 +1,587 @@
|
||||
{
|
||||
"metadata": {
|
||||
"total_size": 6230444800
|
||||
},
|
||||
"weight_map": {
|
||||
"transformer.h.0.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.0.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.1.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.10.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.11.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.12.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.13.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.14.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.15.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.16.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.17.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.18.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.19.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.2.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.20.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.21.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.22.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.23.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.24.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.25.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.26.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.27.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.28.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.29.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.3.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.30.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.31.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.32.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.33.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.34.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.35.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.36.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.37.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.37.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.38.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.39.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.4.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.4.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.40.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.40.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.41.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.42.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.43.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.44.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.45.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.46.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.attn.c_attn.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.attn.c_attn.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.attn.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.attn.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.ln_1.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.ln_1.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.ln_2.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.ln_2.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.mlp.c_fc.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.mlp.c_fc.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.mlp.c_proj.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.47.mlp.c_proj.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.h.5.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.5.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.6.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.7.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.8.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.attn.c_attn.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.attn.c_attn.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.attn.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.attn.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.ln_1.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.ln_1.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.ln_2.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.ln_2.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.mlp.c_fc.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.mlp.c_fc.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.mlp.c_proj.bias": "model-00001-of-00002.safetensors",
|
||||
"transformer.h.9.mlp.c_proj.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.ln_f.bias": "model-00002-of-00002.safetensors",
|
||||
"transformer.ln_f.weight": "model-00002-of-00002.safetensors",
|
||||
"transformer.wpe.weight": "model-00001-of-00002.safetensors",
|
||||
"transformer.wte.weight": "model-00001-of-00002.safetensors"
|
||||
}
|
||||
}
|
||||
23
special_tokens_map.json
Normal file
23
special_tokens_map.json
Normal file
@@ -0,0 +1,23 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"unk_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
100305
tokenizer.json
Normal file
100305
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
19
tokenizer_config.json
Normal file
19
tokenizer_config.json
Normal file
@@ -0,0 +1,19 @@
|
||||
{
|
||||
"add_prefix_space": false,
|
||||
"added_tokens_decoder": {
|
||||
"0": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": false,
|
||||
"normalized": true,
|
||||
"rstrip": false,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
}
|
||||
},
|
||||
"bos_token": "<|endoftext|>",
|
||||
"clean_up_tokenization_spaces": true,
|
||||
"eos_token": "<|endoftext|>",
|
||||
"model_max_length": 512,
|
||||
"tokenizer_class": "GPT2Tokenizer",
|
||||
"unk_token": "<|endoftext|>"
|
||||
}
|
||||
3
training_args.bin
Normal file
3
training_args.bin
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5b6febe1598a3a8a64a9e3497dddeadea635e2603ef4e62f42881e3e75a8277d
|
||||
size 4283
|
||||
1
vocab.json
Normal file
1
vocab.json
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user