lorinet3/gpt-sw3-126m-exercise-scenario-generator
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: lorinet3/gpt-sw3-126m-exercise-scenario-generator
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-18 00:51:16 +08:00
commit 7cbf69a626
40 changed files with 8896 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

40
.gitattributes vendored Normal file
View File

@@ -0,0 +1,40 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
gpt-sw3-126m-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
gpt-sw3-126m-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
gpt-sw3-126m-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
gpt-sw3-126m-fp16.gguf filter=lfs diff=lfs merge=lfs -text
gpt-sw3-126m-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text

199
README.md Normal file
View File

@@ -0,0 +1,199 @@
---
library_name: transformers
tags: []
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Model type:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** [More Information Needed]
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]
## Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
### Direct Use
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
[More Information Needed]
### Downstream Use [optional]
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
[More Information Needed]
### Out-of-Scope Use
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
[More Information Needed]
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
[More Information Needed]
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
## How to Get Started with the Model
Use the code below to get started with the model.
[More Information Needed]
## Training Details
### Training Data
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
[More Information Needed]
### Training Procedure
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
#### Preprocessing [optional]
[More Information Needed]
#### Training Hyperparameters
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
#### Speeds, Sizes, Times [optional]
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
[More Information Needed]
## Evaluation
<!-- This section describes the evaluation protocols and provides the results. -->
### Testing Data, Factors & Metrics
#### Testing Data
<!-- This should link to a Dataset Card if possible. -->
[More Information Needed]
#### Factors
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
[More Information Needed]
#### Metrics
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
[More Information Needed]
### Results
[More Information Needed]
#### Summary
## Model Examination [optional]
<!-- Relevant interpretability work for the model goes here -->
[More Information Needed]
## Environmental Impact
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
- **Hardware Type:** [More Information Needed]
- **Hours used:** [More Information Needed]
- **Cloud Provider:** [More Information Needed]
- **Compute Region:** [More Information Needed]
- **Carbon Emitted:** [More Information Needed]
## Technical Specifications [optional]
### Model Architecture and Objective
[More Information Needed]
### Compute Infrastructure
[More Information Needed]
#### Hardware
[More Information Needed]
#### Software
[More Information Needed]
## Citation [optional]
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
**BibTeX:**
[More Information Needed]
**APA:**
[More Information Needed]
## Glossary [optional]
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
[More Information Needed]
## More Information [optional]
[More Information Needed]
## Model Card Authors [optional]
[More Information Needed]
## Model Card Contact
[More Information Needed]

18
added_tokens.json Normal file
View File

@@ -0,0 +1,18 @@
{
"[A1]": 64012,
"[A2]": 64013,
"[B1]": 64014,
"[B2]": 64015,
"[EXERCISE_VARIATIONS]": 64011,
"[LESSON]": 64009,
"[PRACTICE_TEXT]": 64010,
"antonym_focus": 64007,
"definition_only": 64008,
"fill_in_the_blanks": 64003,
"free_writing": 64000,
"general_vocab": 64004,
"matching_pairs": 64001,
"morphology_focus": 64005,
"reorder_tokens": 64002,
"synonym_focus": 64006
}

18
checkpoint-5000/added_tokens.json Normal file
View File

@@ -0,0 +1,18 @@
{
"[A1]": 64012,
"[A2]": 64013,
"[B1]": 64014,
"[B2]": 64015,
"[EXERCISE_VARIATIONS]": 64011,
"[LESSON]": 64009,
"[PRACTICE_TEXT]": 64010,
"antonym_focus": 64007,
"definition_only": 64008,
"fill_in_the_blanks": 64003,
"free_writing": 64000,
"general_vocab": 64004,
"matching_pairs": 64001,
"morphology_focus": 64005,
"reorder_tokens": 64002,
"synonym_focus": 64006
}

36
checkpoint-5000/config.json Normal file
View File

@@ -0,0 +1,36 @@
{
"activation_function": "gelu",
"apply_query_key_layer_scaling": true,
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 2,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 3,
"initializer_range": 0.023,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 2048,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 4096,
"normalize_attention_scores": true,
"pad_token_id": 0,
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"tokenizer_class": "GPTSw3Tokenizer",
"transformers_version": "4.57.1",
"use_cache": false,
"vocab_size": 64016
}

8
checkpoint-5000/generation_config.json Normal file
View File

@@ -0,0 +1,8 @@
{
"_from_model_config": true,
"bos_token_id": 2,
"eos_token_id": 3,
"pad_token_id": 0,
"transformers_version": "4.57.1",
"use_cache": false
}

3
checkpoint-5000/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1c8409674d4f5f7842bdbe90eafd6f4ee47fd5a324ad1335a27ee50dd3d1464c
size 274779928

3
checkpoint-5000/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebd558a9a8e6f927612096fcee1a8f7eb45ef97e36a8768896f17cb53316d9a8
size 549590475

3
checkpoint-5000/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3fefcda1eb027efef7338951cd8da153385aed51c0764a3508e3386a88297f27
size 14645

3
checkpoint-5000/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:12b1feb292d5e79121d1de1f6c7915c97f017d43ae37c65efa1038db2ec6c3d5
size 1465

127
checkpoint-5000/special_tokens_map.json Normal file
View File

@@ -0,0 +1,127 @@
{
"additional_special_tokens": [
{
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
],
"bos_token": "<s>",
"eos_token": "<|endoftext|>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}

3
checkpoint-5000/spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4bda2cd84ff0ac659cda40e746c55f47ee3e57cf18471670ad26998c28be52d
size 1071955

203
checkpoint-5000/tokenizer_config.json Normal file
View File

@@ -0,0 +1,203 @@
{
"added_tokens_decoder": {
"0": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"3": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"603": {
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64000": {
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64001": {
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64002": {
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64003": {
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64004": {
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64005": {
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64006": {
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64007": {
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64008": {
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64009": {
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64010": {
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64011": {
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64012": {
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64013": {
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64014": {
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64015": {
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"--",
"free_writing",
"matching_pairs",
"reorder_tokens",
"fill_in_the_blanks",
"general_vocab",
"morphology_focus",
"synonym_focus",
"antonym_focus",
"definition_only",
"[LESSON]",
"[PRACTICE_TEXT]",
"[EXERCISE_VARIATIONS]",
"[A1]",
"[A2]",
"[B1]",
"[B2]"
],
"bos_token": "<s>",
"clean_up_tokenization_spaces": false,
"do_lower_case": false,
"eos_token": "<|endoftext|>",
"extra_special_tokens": {},
"keep_accents": false,
"model_max_length": 4096,
"pad_token": "<pad>",
"remove_space": false,
"sp_model_kwargs": {},
"tokenizer_class": "GPTSw3Tokenizer",
"unk_token": "<unk>"
}

3614
checkpoint-5000/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-5000/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28a647ef5efc6ef28f13ecc4d3c99da28526fcc6c25fb933bc470139f20fd302
size 5969

18
checkpoint-5276/added_tokens.json Normal file
View File

@@ -0,0 +1,18 @@
{
"[A1]": 64012,
"[A2]": 64013,
"[B1]": 64014,
"[B2]": 64015,
"[EXERCISE_VARIATIONS]": 64011,
"[LESSON]": 64009,
"[PRACTICE_TEXT]": 64010,
"antonym_focus": 64007,
"definition_only": 64008,
"fill_in_the_blanks": 64003,
"free_writing": 64000,
"general_vocab": 64004,
"matching_pairs": 64001,
"morphology_focus": 64005,
"reorder_tokens": 64002,
"synonym_focus": 64006
}

36
checkpoint-5276/config.json Normal file
View File

@@ -0,0 +1,36 @@
{
"activation_function": "gelu",
"apply_query_key_layer_scaling": true,
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 2,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 3,
"initializer_range": 0.023,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 2048,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 4096,
"normalize_attention_scores": true,
"pad_token_id": 0,
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"tokenizer_class": "GPTSw3Tokenizer",
"transformers_version": "4.57.1",
"use_cache": false,
"vocab_size": 64016
}

8
checkpoint-5276/generation_config.json Normal file
View File

@@ -0,0 +1,8 @@
{
"_from_model_config": true,
"bos_token_id": 2,
"eos_token_id": 3,
"pad_token_id": 0,
"transformers_version": "4.57.1",
"use_cache": false
}

3
checkpoint-5276/model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4c6cf256fc4400f09066715e1b9be14c69ff8a0bc4f8f23bd3c998fdc6395a7c
size 274779928

3
checkpoint-5276/optimizer.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1011c6e5aa36d52d8e337faeefe71ba7399ab8c52536e16d508cb396e0b458f
size 549590475

3
checkpoint-5276/rng_state.pth Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:11feebee6c482d74473263fd2bc20e2034e2ba91a39748e8c922699d428633bc
size 14645

3
checkpoint-5276/scheduler.pt Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4172d8c96ddc50581f82e3368358fca4280c85996ea501cbed64bfa7d37652b9
size 1465

127
checkpoint-5276/special_tokens_map.json Normal file
View File

@@ -0,0 +1,127 @@
{
"additional_special_tokens": [
{
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
],
"bos_token": "<s>",
"eos_token": "<|endoftext|>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}

3
checkpoint-5276/spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4bda2cd84ff0ac659cda40e746c55f47ee3e57cf18471670ad26998c28be52d
size 1071955

203
checkpoint-5276/tokenizer_config.json Normal file
View File

@@ -0,0 +1,203 @@
{
"added_tokens_decoder": {
"0": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"3": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"603": {
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64000": {
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64001": {
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64002": {
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64003": {
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64004": {
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64005": {
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64006": {
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64007": {
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64008": {
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64009": {
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64010": {
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64011": {
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64012": {
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64013": {
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64014": {
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64015": {
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"--",
"free_writing",
"matching_pairs",
"reorder_tokens",
"fill_in_the_blanks",
"general_vocab",
"morphology_focus",
"synonym_focus",
"antonym_focus",
"definition_only",
"[LESSON]",
"[PRACTICE_TEXT]",
"[EXERCISE_VARIATIONS]",
"[A1]",
"[A2]",
"[B1]",
"[B2]"
],
"bos_token": "<s>",
"clean_up_tokenization_spaces": false,
"do_lower_case": false,
"eos_token": "<|endoftext|>",
"extra_special_tokens": {},
"keep_accents": false,
"model_max_length": 4096,
"pad_token": "<pad>",
"remove_space": false,
"sp_model_kwargs": {},
"tokenizer_class": "GPTSw3Tokenizer",
"unk_token": "<unk>"
}

3803
checkpoint-5276/trainer_state.json Normal file
View File

File diff suppressed because it is too large Load Diff

3
checkpoint-5276/training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28a647ef5efc6ef28f13ecc4d3c99da28526fcc6c25fb933bc470139f20fd302
size 5969

37
config.json Normal file
View File

@@ -0,0 +1,37 @@
{
"activation_function": "gelu",
"apply_query_key_layer_scaling": true,
"architectures": [
"GPT2LMHeadModel"
],
"attn_pdrop": 0.1,
"bos_token_id": 2,
"dtype": "bfloat16",
"embd_pdrop": 0.1,
"eos_token_id": 3,
"initializer_range": 0.023,
"layer_norm_epsilon": 1e-05,
"model_type": "gpt2",
"n_ctx": 4096,
"n_embd": 768,
"n_head": 12,
"n_inner": 3072,
"n_layer": 12,
"n_positions": 4096,
"normalize_attention_scores": true,
"pad_token_id": 0,
"reorder_and_upcast_attn": false,
"resid_pdrop": 0.1,
"scale_attn_by_inverse_layer_idx": false,
"scale_attn_weights": true,
"summary_activation": null,
"summary_first_dropout": 0.1,
"summary_proj_to_labels": true,
"summary_type": "cls_index",
"summary_use_proj": true,
"tokenizer_class": "GPTSw3Tokenizer",
"transformers_version": "4.57.1",
"use_cache": false,
"vocab_size": 64016,
"max_position_embeddings": 4096
}

8
generation_config.json Normal file
View File

@@ -0,0 +1,8 @@
{
"_from_model_config": true,
"bos_token_id": 2,
"eos_token_id": 3,
"pad_token_id": 0,
"transformers_version": "4.57.1",
"use_cache": false
}

3
gpt-sw3-126m-fp16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6f69d625cecbc7a5587705c932d951a1c178a9c74fb617ba4864281122d3f5fa
size 282794848

3
gpt-sw3-126m-q4_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:46db00c68b2d56a42625226aacd8fda630c310b43afa11dbf2145ee88e91f1e2
size 109089472

3
gpt-sw3-126m-q5_k_m.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:98b61651505304e43a7220dba102f92ba20bf76ae01b6c3d67f7a2284df2b4ec
size 116609728

3
gpt-sw3-126m-q6_k.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f0b11c05901294aa28d124686953e879cd7f9a543351a37c1e0590e956b53b57
size 124600000

3
gpt-sw3-126m-q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:427d3e0405b3dd06397acfdafb7e57194f9fff9f6d5975e4b7133a78558e651b
size 157077088

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:559430d7e10555635f26dfc35386b8342f4909c661317ebe70468670cd5553f6
size 274747040

127
special_tokens_map.json Normal file
View File

@@ -0,0 +1,127 @@
{
"additional_special_tokens": [
{
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
{
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
],
"bos_token": "<s>",
"eos_token": "<|endoftext|>",
"pad_token": "<pad>",
"unk_token": "<unk>"
}

3
spiece.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4bda2cd84ff0ac659cda40e746c55f47ee3e57cf18471670ad26998c28be52d
size 1071955

3
tokenizer.model Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4bda2cd84ff0ac659cda40e746c55f47ee3e57cf18471670ad26998c28be52d
size 1071955

203
tokenizer_config.json Normal file
View File

@@ -0,0 +1,203 @@
{
"added_tokens_decoder": {
"0": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"3": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"603": {
"content": "--",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64000": {
"content": "free_writing",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64001": {
"content": "matching_pairs",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64002": {
"content": "reorder_tokens",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64003": {
"content": "fill_in_the_blanks",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64004": {
"content": "general_vocab",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64005": {
"content": "morphology_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64006": {
"content": "synonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64007": {
"content": "antonym_focus",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64008": {
"content": "definition_only",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64009": {
"content": "[LESSON]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64010": {
"content": "[PRACTICE_TEXT]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64011": {
"content": "[EXERCISE_VARIATIONS]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64012": {
"content": "[A1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64013": {
"content": "[A2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64014": {
"content": "[B1]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"64015": {
"content": "[B2]",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [
"--",
"free_writing",
"matching_pairs",
"reorder_tokens",
"fill_in_the_blanks",
"general_vocab",
"morphology_focus",
"synonym_focus",
"antonym_focus",
"definition_only",
"[LESSON]",
"[PRACTICE_TEXT]",
"[EXERCISE_VARIATIONS]",
"[A1]",
"[A2]",
"[B1]",
"[B2]"
],
"bos_token": "<s>",
"clean_up_tokenization_spaces": false,
"do_lower_case": false,
"eos_token": "<|endoftext|>",
"extra_special_tokens": {},
"keep_accents": false,
"model_max_length": 4096,
"pad_token": "<pad>",
"remove_space": false,
"sp_model_kwargs": {},
"tokenizer_class": "GPTSw3Tokenizer",
"unk_token": "<unk>"
}

3
training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:28a647ef5efc6ef28f13ecc4d3c99da28526fcc6c25fb933bc470139f20fd302
size 5969