EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
36078fb24760de837b95f4bea87ede00c0fd91e8
sglang/python/sglang
History
Liangsheng Yin 36078fb247 fix schedule bug (#1450)
2024-09-17 16:33:53 -07:00
..
lang
Remove deprecated configs (#1431)
2024-09-15 08:52:18 -07:00
srt
fix schedule bug (#1450)
2024-09-17 16:33:53 -07:00
test
Remove deprecated configs (#1431)
2024-09-15 08:52:18 -07:00
__init__.py
Feat: add alternative choices selection methods (#835)
2024-08-05 03:27:49 -07:00
api.py
make json_schema usable from gen (#1254)
2024-08-28 18:57:10 -07:00
bench_latency.py
Remove deprecated configs (#1431)
2024-09-15 08:52:18 -07:00
bench_serving.py
[Minor] Many cleanup (#1357)
2024-09-09 04:14:11 -07:00
check_env.py
misc: add hypervisor vendor (#1165)
2024-08-21 02:14:51 +10:00
global_config.py
Remove deprecated configs (#1431)
2024-09-15 08:52:18 -07:00
launch_server_llavavid.py
[Minor] Many cleanup (#1357)
2024-09-09 04:14:11 -07:00
launch_server.py
[Minor] Many cleanup (#1357)
2024-09-09 04:14:11 -07:00
README.md
Balance test in CI (#1411)
2024-09-12 23:29:44 -07:00
utils.py
[Minor] Many cleanup (#1357)
2024-09-09 04:14:11 -07:00
version.py
Release 0.3.1.post1 (#1445)
2024-09-17 01:47:31 -07:00

README.md

Code Structures

  • lang: The frontend language.
  • srt: The backend engine for running local models. (SRT = SGLang Runtime).
  • test: The test utilities.
  • api.py: The public APIs.
  • bench_latency.py: Benchmark a single static batch.
  • bench_serving.py: Benchmark online serving with dynamic requests.
  • global_config.py: The global configs and constants.
  • launch_server.py: The entry point for launching the local server.
  • utils.py: Common utilities.