EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

[Bug]: Add missing clamp to llavavid (#3787)

Browse Source
This commit is contained in:
Yueyang Pan
2025-02-25 04:10:15 +01:00
committed by GitHub
parent 6ce9dbe828
commit 7036d6fc67
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
python/sglang/srt/models/llavavid.py
View File

@@ -110,6 +110,9 @@ class LlavaVidForCausalLM(nn.Module):
if forward_batch.forward_mode.is_extend(): if forward_batch.forward_mode.is_extend():
bs = forward_batch.batch_size bs = forward_batch.batch_size
# Clamp input ids. See llava.py for more details
input_ids = input_ids.clamp_(min=0, max=self.config.vocab_size - 1)
# Embed text inputs # Embed text inputs
input_embeds = self.language_model.model.embed_tokens(input_ids) input_embeds = self.language_model.model.embed_tokens(input_ids)