Lianmin Zheng 2a02185c5f Rename DP_RANK to SGLANG_DP_RANK (#2218)

2024-11-27 09:36:36 -08:00

..

configs

Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222)

2024-11-27 02:52:46 -08:00

constrained

Update XGrammar to the latest API (#2176)

2024-11-25 15:58:30 -08:00

layers

Use an env var SGLANG_SET_CPU_AFFINITY to set cpu affinity; turn it off by default (#2222)

2024-11-27 02:52:46 -08:00

lora

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

managers

Rename DP_RANK to SGLANG_DP_RANK (#2218)

2024-11-27 09:36:36 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

Input_embeds support (#2052)

2024-11-25 16:35:04 -08:00

models

[feat] Support session control for vision language models (#2210)

2024-11-27 00:03:29 -08:00

openai_api

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampling

[Fix] Avoid calling fill_vocab_mask for terminated requests (#2175)

2024-11-25 17:31:25 +08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

Fix mixed chunked prefill in overlap mode (#2158)

2024-11-24 07:17:37 -08:00

server.py

add sglang version to get_server_info (#2206)

2024-11-26 12:10:23 -08:00

utils.py

Release v0.3.6.post2 (#2214)

2024-11-27 03:35:30 -08:00