EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Update TypeBasedDispatcher and balance CI tests (#3001)

Browse Source
This commit is contained in:
Lianmin Zheng
2025-01-19 23:37:27 -08:00
committed by GitHub
parent 03464890e0
commit 09bcbe0123
2 changed files with 5 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.github/workflows/pr-test.yml vendored
View File

@@ -52,7 +52,7 @@ jobs:
runs-on: 1-gpu-runner runs-on: 1-gpu-runner
strategy: strategy:
matrix: matrix:
range: [0-6, 6-15, 15-22, 22-32, 32-37, 37-100] range: [0-6, 6-15, 15-22, 22-32, 32-40, 40-100]
steps: steps:
- name: Checkout code - name: Checkout code
uses: actions/checkout@v3 uses: actions/checkout@v3

7
python/sglang/srt/managers/tokenizer_manager.py
View File

@@ -226,9 +226,10 @@ class TokenizerManager:
self._result_dispatcher = TypeBasedDispatcher( self._result_dispatcher = TypeBasedDispatcher(
[ [
(BatchStrOut, self._handle_batch_output), (
(BatchEmbeddingOut, self._handle_batch_output), (BatchStrOut, BatchEmbeddingOut, BatchTokenIDOut),
(BatchTokenIDOut, self._handle_batch_output), self._handle_batch_output,
),
(OpenSessionReqOutput, self._handle_open_session_req_output), (OpenSessionReqOutput, self._handle_open_session_req_output),
( (
UpdateWeightFromDiskReqOutput, UpdateWeightFromDiskReqOutput,