EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614)

Browse Source
This commit is contained in:
Vincent Zhong
2025-09-29 02:18:29 -04:00
committed by GitHub
parent 24f7cb1ece
commit 71959545df
1 changed files with 0 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/srt/models/gemma3_causal.py
View File

@@ -20,7 +20,6 @@ import torch.nn.functional as F
from torch import nn from torch import nn
from transformers import ( from transformers import (
ROPE_INIT_FUNCTIONS, ROPE_INIT_FUNCTIONS,
AutoModel,
Gemma3TextConfig, Gemma3TextConfig,
PretrainedConfig, PretrainedConfig,
PreTrainedModel, PreTrainedModel,
@@ -761,4 +760,3 @@ class Gemma3ForCausalLM(PreTrainedModel):
EntryClass = Gemma3ForCausalLM EntryClass = Gemma3ForCausalLM
AutoModel.register(Gemma3TextConfig, Gemma3ForCausalLM, exist_ok=True)