EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

fix bug of VLLM_AVAILABLE not defined (#5497)

Browse Source
This commit is contained in:
liwenju0
2025-04-18 15:59:03 +08:00
committed by GitHub
parent bed05878f6
commit e465b08ddb
1 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
python/sglang/srt/layers/quantization/compressed_tensors/compressed_tensors.py
View File

@@ -40,6 +40,13 @@ from sglang.srt.layers.quantization.compressed_tensors.utils import (
should_ignore_layer, should_ignore_layer,
) )
try:
import vllm
VLLM_AVAILABLE = True
except ImportError:
VLLM_AVAILABLE = False
logger = logging.getLogger(__name__) logger = logging.getLogger(__name__)
__all__ = ["CompressedTensorsLinearMethod"] __all__ = ["CompressedTensorsLinearMethod"]