EngineX-Hygon/sglang

Files

History

Liangsheng Yin d9fccfefe2 Fix context length (#757 )

2024-07-26 18:13:13 -07:00

..

Fix StreamExecutor.fork() losing the current role start index. (#684 )

2024-07-20 23:32:11 -07:00

Fix context length (#757 )

2024-07-26 18:13:13 -07:00

Update OpenAI API (#667 )

2024-07-19 23:20:54 -07:00

__init__.py

chore: bump v0.1.25 (#725 )

2024-07-25 20:04:35 +10:00

api.py

Update Readme (#660 )

2024-07-19 09:54:01 -07:00

bench_latency.py

Flashinfer sample kernel (#617 )

2024-07-17 13:24:43 -07:00

bench_serving.py

fix benchmark (#743 )

2024-07-26 21:26:13 +10:00

check_env.py

Improve docs (#662 )

2024-07-19 10:58:03 -07:00

global_config.py

fix benchmark (#743 )

2024-07-26 21:26:13 +10:00

launch_server_llavavid.py

Remove the dependency of rpyc (#646 )

2024-07-18 02:13:54 -07:00

launch_server.py

Remove the dependency of rpyc (#646 )

2024-07-18 02:13:54 -07:00

README.md

Improve docs (#662 )

2024-07-19 10:58:03 -07:00

utils.py

Higher priority for user input of max_prefill_tokens & format (#540 )

2024-06-12 21:48:40 -07:00

version.py

fix: use REPO_TOKEN (#755 )

2024-07-27 05:56:30 +10:00

README.md

Code Structure

lang: The frontend language.
srt: The backend engine for running local models. (SRT = SGLang Runtime).
test: Test utilities.
api.py: Public API.
bench_latency.py: Benchmark a single static batch.
bench_serving.py: Benchmark online serving with dynamic requests.
global_config.py: The global configs and constants.
launch_server.py: The entry point of launching local server.
utils.py: Common utilities.