EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity

Update version to 0.1.22 (#677)

Browse Source
This commit is contained in:
Ying Sheng
2024-07-20 03:39:50 -07:00
committed by GitHub
parent f424e76d96
commit 2b4c646277
4 changed files with 6 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@@ -166,7 +166,7 @@ python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct
- `python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000` - `python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-vicuna-7b --tokenizer-path llava-hf/llava-1.5-7b-hf --chat-template vicuna_v1.1 --port 30000`
- `python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 30000` - `python -m sglang.launch_server --model-path liuhaotian/llava-v1.6-34b --tokenizer-path liuhaotian/llava-v1.6-34b-tokenizer --port 30000`
- LLaVA-NeXT-Video - LLaVA-NeXT-Video
- see [srt_example_llava_v.sh](examples/usage/llava_video/srt_example_llava_v.sh) - see [examples/usage/llava_video](examples/usage/llava_video)
- Yi-VL - Yi-VL
- see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py). - see [srt_example_yi_vl.py](examples/quick_start/srt_example_yi_vl.py).
- StableLM - StableLM

4
examples/usage/llava_video/srt_example_llava_v.py
View File

@@ -1,5 +1,7 @@
""" """
Usage: python3 srt_example_llava.py Usage:
pip install opencv-python-headless
python3 srt_example_llava.py
""" """
import argparse import argparse

2
python/pyproject.toml
View File

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
[project] [project]
name = "sglang" name = "sglang"
version = "0.1.21" version = "0.1.22"
description = "SGLang is yet another fast serving framework for large language models and vision language models." description = "SGLang is yet another fast serving framework for large language models and vision language models."
readme = "README.md" readme = "README.md"
requires-python = ">=3.8" requires-python = ">=3.8"

2
python/sglang/__init__.py
View File

@@ -1,4 +1,4 @@
__version__ = "0.1.21" __version__ = "0.1.22"
# SGL API Components # SGL API Components
from sglang.api import ( from sglang.api import (