初始化项目,由ModelHub XC社区提供模型

Model: syp1229/wav2vec2-large-xls-r-300m-korean_y_freq
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-19 02:28:43 +08:00
commit 1013043699
40 changed files with 1690 additions and 0 deletions

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

97
README.md Normal file
View File

@@ -0,0 +1,97 @@
---
license: apache-2.0
base_model: facebook/wav2vec2-xls-r-300m
tags:
- generated_from_trainer
model-index:
- name: wav2vec2-large-xls-r-300m-korean_y_freq
results: []
---
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
# wav2vec2-large-xls-r-300m-korean_y_freq
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-300m](https://huggingface.co/facebook/wav2vec2-xls-r-300m) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 0.4522
- Cer: 13.5023
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure
### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0001
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 100
- num_epochs: 5
- mixed_precision_training: Native AMP
### Training results
| Training Loss | Epoch | Step | Validation Loss | Cer |
|:-------------:|:-----:|:----:|:---------------:|:-------:|
| 35.2803 | 0.13 | 200 | 5.5453 | 100.0 |
| 4.6452 | 0.26 | 400 | 4.6065 | 100.0 |
| 4.5568 | 0.39 | 600 | 4.5732 | 97.9643 |
| 4.492 | 0.52 | 800 | 4.5091 | 97.9643 |
| 4.343 | 0.64 | 1000 | 4.2369 | 95.5012 |
| 3.3778 | 0.77 | 1200 | 2.7151 | 49.3917 |
| 2.4127 | 0.9 | 1400 | 2.2297 | 42.1509 |
| 2.0113 | 1.03 | 1600 | 1.8500 | 35.5926 |
| 1.7037 | 1.16 | 1800 | 1.5783 | 31.7942 |
| 1.502 | 1.29 | 2000 | 1.4251 | 29.2184 |
| 1.3376 | 1.42 | 2200 | 1.3812 | 30.4232 |
| 1.2586 | 1.55 | 2400 | 1.1952 | 25.6751 |
| 1.1415 | 1.68 | 2600 | 1.1614 | 25.8176 |
| 1.0858 | 1.81 | 2800 | 1.0985 | 24.9154 |
| 0.9846 | 1.93 | 3000 | 0.9985 | 21.8826 |
| 0.9443 | 2.06 | 3200 | 0.8759 | 19.9359 |
| 0.8298 | 2.19 | 3400 | 0.8549 | 19.5798 |
| 0.8111 | 2.32 | 3600 | 0.8271 | 22.2506 |
| 0.7507 | 2.45 | 3800 | 0.7808 | 20.9389 |
| 0.7202 | 2.58 | 4000 | 0.7409 | 19.5323 |
| 0.7121 | 2.71 | 4200 | 0.7139 | 18.5649 |
| 0.6639 | 2.84 | 4400 | 0.6726 | 17.4669 |
| 0.6595 | 2.97 | 4600 | 0.6830 | 16.6301 |
| 0.6161 | 3.09 | 4800 | 0.6334 | 15.5677 |
| 0.5604 | 3.22 | 5000 | 0.5943 | 14.4460 |
| 0.5387 | 3.35 | 5200 | 0.6169 | 15.4727 |
| 0.5317 | 3.48 | 5400 | 0.5831 | 15.0751 |
| 0.5171 | 3.61 | 5600 | 0.5414 | 14.3807 |
| 0.5 | 3.74 | 5800 | 0.5307 | 14.1789 |
| 0.4888 | 3.87 | 6000 | 0.5171 | 14.4875 |
| 0.4826 | 4.0 | 6200 | 0.5011 | 13.9712 |
| 0.4311 | 4.13 | 6400 | 0.5131 | 14.2679 |
| 0.4178 | 4.26 | 6600 | 0.4929 | 14.0364 |
| 0.3999 | 4.38 | 6800 | 0.4791 | 14.3451 |
| 0.4029 | 4.51 | 7000 | 0.4885 | 13.8584 |
| 0.3922 | 4.64 | 7200 | 0.4759 | 14.2323 |
| 0.3804 | 4.77 | 7400 | 0.4584 | 13.6091 |
| 0.3748 | 4.9 | 7600 | 0.4522 | 13.5023 |
### Framework versions
- Transformers 4.35.2
- Pytorch 2.1.0+cu121
- Datasets 2.16.0
- Tokenizers 0.15.0

4
added_tokens.json Normal file
View File

@@ -0,0 +1,4 @@
{
"</s>": 1286,
"<s>": 1285
}

109
config.json Normal file
View File

@@ -0,0 +1,109 @@
{
"_name_or_path": "facebook/wav2vec2-xls-r-300m",
"activation_dropout": 0.0,
"adapter_attn_dim": null,
"adapter_kernel_size": 3,
"adapter_stride": 2,
"add_adapter": false,
"apply_spec_augment": true,
"architectures": [
"Wav2Vec2ForCTC"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"classifier_proj_size": 256,
"codevector_dim": 768,
"contrastive_logits_temperature": 0.1,
"conv_bias": true,
"conv_dim": [
512,
512,
512,
512,
512,
512,
512
],
"conv_kernel": [
10,
3,
3,
3,
3,
2,
2
],
"conv_stride": [
5,
2,
2,
2,
2,
2,
2
],
"ctc_loss_reduction": "mean",
"ctc_zero_infinity": false,
"diversity_loss_weight": 0.1,
"do_stable_layer_norm": true,
"eos_token_id": 2,
"feat_extract_activation": "gelu",
"feat_extract_dropout": 0.0,
"feat_extract_norm": "layer",
"feat_proj_dropout": 0.0,
"feat_quantizer_dropout": 0.0,
"final_dropout": 0.0,
"gradient_checkpointing": false,
"hidden_act": "gelu",
"hidden_dropout": 0.0,
"hidden_size": 1024,
"initializer_range": 0.02,
"intermediate_size": 4096,
"layer_norm_eps": 1e-05,
"layerdrop": 0.0,
"mask_feature_length": 10,
"mask_feature_min_masks": 0,
"mask_feature_prob": 0.05,
"mask_time_length": 10,
"mask_time_min_masks": 2,
"mask_time_prob": 0.05,
"model_type": "wav2vec2",
"num_adapter_layers": 3,
"num_attention_heads": 16,
"num_codevector_groups": 2,
"num_codevectors_per_group": 320,
"num_conv_pos_embedding_groups": 16,
"num_conv_pos_embeddings": 128,
"num_feat_extract_layers": 7,
"num_hidden_layers": 24,
"num_negatives": 100,
"output_hidden_size": 1024,
"pad_token_id": 1284,
"proj_codevector_dim": 768,
"tdnn_dilation": [
1,
2,
3,
1,
1
],
"tdnn_dim": [
512,
512,
512,
512,
1500
],
"tdnn_kernel": [
5,
3,
3,
1,
1
],
"torch_dtype": "float32",
"transformers_version": "4.35.2",
"use_weighted_layer_sum": false,
"vocab_size": 1287,
"xvector_output_dim": 512
}

3
model.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:7cae0cc8d44799bc05c155ff3a091f8f2638676d044fc16d54f866966c964abe
size 1267084196

9
preprocessor_config.json Normal file
View File

@@ -0,0 +1,9 @@
{
"do_normalize": true,
"feature_extractor_type": "Wav2Vec2FeatureExtractor",
"feature_size": 1,
"padding_side": "right",
"padding_value": 0.0,
"return_attention_mask": true,
"sampling_rate": 16000
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3618a913824c32afb051638a06cacf1bb507355d4a7b9717e1a4b192619547be
size 17009

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2da8015775e564ea468a7ac6a5d6536c4005ea12d514e13c3380fd7055c4e67f
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:83549e0ff065c481b0570295a13c1f8905bd5559814ccf673509010f98eef304
size 24134

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:a1336d0507adebeedd0d4126e46136686e7c2b79d1018826e7d00684a6f704c9
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72994f6a45d9b60f5e418b59ad2b3633cacc57afadc5a906ae9d13c484576727
size 24134

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9c2f6c90014169ea8d3d26f20eb112608fbb6f39ac48ce48caa35551d2615b01
size 26035

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9d323b83d2688c1189ff967caeb6650cd5cea2edfa724d9739b22d8bea5a3a3
size 11431

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4d0f387f9c8aa49fa0629c517641a06631f98396a9a920ca288fc076a523f4ec
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:00638984d2a495ff907232eca111d6b4b75a444730e1ecb279153132d5a1e7d5
size 7631

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cde71ed7a49c04a5a353c22e07cd21b21663b72c7edc57ec0cff816d58251177
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f799c7cccc12f47e5bfbdb394a6405e989628fa8477685aa060b1a4cdf373c1e
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:b35a5916fed32d72c884d623b16b5ff5740b80c10aa17be38e90e5ed213b6c8a
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:37851e5b7450ffac4cd355869efe7c6f4bcf8eb1302a8d301b56eb243c59672c
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9e2e16eb3b527f396cdda8e60308891f8a96270233e55ef01079e557d37e5d42
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ff35febb2d13c551f46fb3a7766572db3a75c1e6aa4a269a46ce4cc7bcc68e38
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:8fa43682eb188524cb38ad49d67497a7b4ef0baff0d7f0d8bc683a26915e2dd4
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:17fbb7759e99a518ca406b04ae14382c5934fd31a75c932d7b4639c3d3a191be
size 24135

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:13608a6883a29d47579ccb3997a440fcb43345cf2c1a9585893b2e0ead3a082d
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:679318724ef18245a7b96f227d7a4cbb824b66d395c8960b9f07a3c4b24f8fc5
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d58b7e97116591c756d6c7b52ca33a5d13e4d0b951c8eb882143335d850a3279
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fa1d89dcbd7af88c3d7ef3c7029892b93788d7e9fdf38109bf4ae7ed251fd075
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79ec74182046b7cf6f36d973ce834418670f1775d048e8eb3691cfd7fa5a275d
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:739a06e0200da9b10b4f973a7d12bce3209f972c295b50581daf0b53e8ef6796
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54dc94c5c24fc6529a86e29de1a1b47ffe73a719d1930ac517d74c84ee47f7ad
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9d97d11736bfebeed7af61bd028ea92bc005dfd03132469aa064557662c07cdb
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3f61d4fe1cc8323b2e3117ccff7cfb4f29b08edd9ff1db464a4a75d2dabb2c9d
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9f9895492e06504fcbfb8c8e25050e99b2961cbd84a70a080bb3824373372f8a
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e18b2b840c8beda01c425abaf75b806bfc2f536ab03892f0da3fd4bf1303d66a
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9cd3ccecbba53cd0158fd172ef1492f01dee8b3f1911bfc7b667457023d13265
size 24136

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0a350903106ea36c2e043238338d8079fbf682b3757852be4fe1c3593362ef96
size 24136

6
special_tokens_map.json Normal file
View File

@@ -0,0 +1,6 @@
{
"bos_token": "<s>",
"eos_token": "</s>",
"pad_token": "[PAD]",
"unk_token": "[UNK]"
}

47
tokenizer_config.json Normal file
View File

@@ -0,0 +1,47 @@
{
"added_tokens_decoder": {
"1283": {
"content": "[UNK]",
"lstrip": true,
"normalized": false,
"rstrip": true,
"single_word": false,
"special": false
},
"1284": {
"content": "[PAD]",
"lstrip": true,
"normalized": false,
"rstrip": true,
"single_word": false,
"special": false
},
"1285": {
"content": "<s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false,
"special": true
},
"1286": {
"content": "</s>",
"lstrip": false,
"normalized": true,
"rstrip": false,
"single_word": false,
"special": true
}
},
"bos_token": "<s>",
"clean_up_tokenization_spaces": true,
"do_lower_case": false,
"eos_token": "</s>",
"model_max_length": 1000000000000000019884624838656,
"pad_token": "[PAD]",
"replace_word_delimiter_char": " ",
"target_lang": null,
"tokenizer_class": "Wav2Vec2CTCTokenizer",
"unk_token": "[UNK]",
"word_delimiter_token": "|"
}

3
training_args.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:387a0451718c2c0e06feb6544f8533e06c26033966f56fd5dfd792a3f485e83c
size 4600

1287
vocab.json Normal file

File diff suppressed because it is too large Load Diff