Files

yichuan~ b997a18d74 [Feat]Add support for optional start len of logprobs (#1035 )

Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

2024-08-18 23:45:41 -07:00

lang

Use dtype to control generate (#1082 )

2024-08-14 15:58:07 +00:00

srt

[Feat]Add support for optional start len of logprobs (#1035 )

2024-08-18 23:45:41 -07:00

killall_sglang.sh

Fix logit processor bugs (#427 )

2024-05-12 04:54:07 -07:00

README.md

Clean up unit tests (#1020 )

2024-08-10 15:09:03 -07:00

README.md

Run Unit Tests

SGLang uses the built-in library unittest as the testing framework.

Test Backend Runtime

cd sglang/test/srt

# Run a single file
python3 test_srt_endpoint.py

# Run a single test
python3 -m unittest test_srt_endpoint.TestSRTEndpoint.test_simple_decode

# Run a suite with multiple files
python3 run_suite.py --suite minimal

Test Frontend Language

cd sglang/test/lang
export OPENAI_API_KEY=sk-*****

# Run a single file
python3 test_openai_backend.py

# Run a single test
python3 -m unittest test_openai_backend.TestOpenAIBackend.test_few_shot_qa

# Run a suite with multiple files
python3 run_suite.py --suite minimal