Files
RightNow-Arabic-0.5B-Turbo/tokenizer_fertility.json
ModelHub XC 3b4ff912d1 初始化项目,由ModelHub XC社区提供模型
Model: RightNowAI/RightNow-Arabic-0.5B-Turbo
Source: Original Platform
2026-11-03 13:37:19 +08:00

10 lines
250 B
JSON

{
"words": 368,
"ours_tokens": 664,
"ours_fertility": 1.8043478260869565,
"baseline_tokens": 803,
"baseline_fertility": 2.182065217391304,
"reduction_pct": 17.310087173100865,
"ours_vocab_size": 178697,
"baseline_vocab_size": 151665
}