ray0rf1re/Nano-Nano_v5.1
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: ray0rf1re/Nano-Nano_v5.1
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-15 21:56:43 +08:00
commit 2f5adbaa8b
18 changed files with 502196 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
tokenizer/README.md Normal file
View File

@@ -0,0 +1,5 @@
# nano-X1 Tokenizer
ByteLevel BPE tokenizer based on EleutherAI/gpt-neox-20b with ChatML + `<think>`/`</think>` special tokens added.
Load: `AutoTokenizer.from_pretrained('./nano_v5_tok_nanox1')`