2 Commits
v1.0 ... v1.0.0

Author SHA1 Message Date
4paradigm
750992c82d fix tokenizer
All checks were successful
Docker Build and Push / docker (push) Successful in 1m5s
2026-07-22 14:40:10 +08:00
4paradigm
500f2bba0d fix tokenizer 2026-07-22 14:38:23 +08:00
2 changed files with 5 additions and 5 deletions

View File

@@ -7,7 +7,7 @@ on:
jobs:
docker:
runs-on: amd64-ubuntu-24.04
runs-on: arm64-ubuntu-24.04
steps:
- name: Clone repository

View File

@@ -6,10 +6,10 @@
部分模型的 `tokenizer_config.json` 存在以下问题,导致 vLLM 服务启动失败(错误码 `TOKENIZER_FAILED`
| 错误 | 原因 | 受影响模型数 |
|---|---|---|
| `ValueError: Tokenizer class TokenizersBackend does not exist` | `tokenizer_class` 不是 transformers 合法类名 | 10 |
| `AttributeError: 'list' object has no attribute 'keys'` | `extra_special_tokens` 为 list 格式transformers 要求 dict | 15 |
| 错误 | 原因 |
|---|---|
| `ValueError: Tokenizer class TokenizersBackend does not exist` | `tokenizer_class` 不是 transformers 合法类名 |
| `AttributeError: 'list' object has no attribute 'keys'` | `extra_special_tokens` 为 list 格式transformers 要求 dict |
详见 `tokenizer_error_classification_summary.md`