lbox/lcube-base
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: lbox/lcube-base
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-29 02:00:19 +08:00
commit 159c6f3340
10 changed files with 50112 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
tokenizer_config.json Normal file
View File

@@ -0,0 +1 @@
{"unk_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "bos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "eos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "add_prefix_space": true, "errors": "replace", "special_tokens_map_file": "../data/models/backbones/lbox-open-gpt-small-50k/special_tokens_map.json", "name_or_path": "../data/models/backbones/lbox-open-gpt-small-50k", "tokenizer_class": "GPT2Tokenizer"}