Yuhong Guo b36ab493b3 Enable setting sglang logger from Env Variable SGLANG_LOGGING_CONFIG_PATH (#4592) ...

Signed-off-by: Yuhong Guo <yuhong.gyh@antgroup.com>

2025-03-20 02:10:32 -07:00

..

configs

[Feature] Support Deepseek-VL2 (#2798)

2025-03-16 23:07:59 -07:00

connector

feat(remote_model): support variable remote backend for model loader (#3964)

2025-03-14 00:40:44 -07:00

constrained

[Fix & Style] Refactor the grammar backend to reduce human errors and improve readability (#4030)

2025-03-04 03:56:45 -08:00

distributed

Reduce computation and communication in DP attention (#4521)

2025-03-18 13:41:36 -07:00

entrypoints

[Fix] Resolve GPU Memory Leak in update_weights_from_tensor (#4446)

2025-03-17 08:54:30 +00:00

layers

[fix] fix illegal mem access and clean up triton attention backend (#4571)

2025-03-20 02:01:52 -07:00

lora

[Feature] Support Tensor Parallelism and Weight Slicing for Lora (#4274)

2025-03-18 20:33:07 -07:00

managers

[Feature] Integrate DeepEP into SGLang (#4232)

2025-03-19 08:16:31 -07:00

mem_cache

Unit test for Hierarchical Caching (#4486)

2025-03-17 17:45:00 -07:00

metrics

Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128)

2025-03-06 00:13:20 -08:00

model_executor

[fix] fix illegal mem access and clean up triton attention backend (#4571)

2025-03-20 02:01:52 -07:00

model_loader

Fix: modelscope env comment (#4474)

2025-03-16 18:11:33 -07:00

models

avoid cudaStreamSynchronize in DeepSeekV2AttentionMLA (#4577)

2025-03-19 10:02:26 -07:00

openai_api

Constraint Decoding: Tool call with text (#4067)

2025-03-17 01:06:46 -07:00

sampling

[Fix] use torch.cat instead of torch.concat to prevent entering the Autograd backends. (#4466)

2025-03-16 00:02:47 -07:00

speculative

[Fix] Fix raw_bs bug when using flashinfer mla and eagle (#4557)

2025-03-18 21:26:53 -07:00

_custom_ops.py

use sgl custom all reduce (#4441)

2025-03-18 00:46:41 -07:00

aio_rwlock.py

A better aio rwlock that guarantees the order (#2547)

2024-12-22 15:44:32 -08:00

code_completion_parser.py

Feature: support code completion (#3612)

2025-03-16 18:26:19 -07:00

conversation.py

[Feature] Support Deepseek-VL2 (#2798)

2025-03-16 23:07:59 -07:00

custom_op.py

Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215)

2025-03-12 00:08:03 -07:00

function_call_parser.py

Constraint Decoding: Tool call with text (#4067)

2025-03-17 01:06:46 -07:00

hf_transformers_utils.py

[Feature] Support Deepseek-VL2 (#2798)

2025-03-16 23:07:59 -07:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

Make torch TP composable with torchao (#2436)

2024-12-11 04:21:42 -08:00

reasoning_parser.py

Reasoning parser (#4000)

2025-03-03 21:16:36 -08:00

server_args.py

Support FlashMLA backend cuda graph (#4514)

2025-03-19 08:25:34 -07:00

server.py

Misc fixes for eagle (flush_cache, CPU overhead) (#3014)

2025-01-20 20:27:38 -08:00

torch_memory_saver_adapter.py

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

utils.py

Enable setting sglang logger from Env Variable SGLANG_LOGGING_CONFIG_PATH (#4592)

2025-03-20 02:10:32 -07:00

warmup.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00