EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
3,095 Commits 8 Branches 0 Tags
3c8a52311a432fffc34bb002b5a42fcd884e02eb
Commit Graph

577 Commits

Author SHA1 Message Date
saienduri
e3a5304475 Add AMD MI300x Nightly Testing. (#5861) 2025-04-29 17:34:32 -07:00
Chang Su
2b06484bd1 feat: support pythonic tool call and index in tool call streaming (#5725) 2025-04-29 17:30:44 -07:00
Chang Su
9419e75d60 [CI] Add test_function_calling.py to run_suite.py (#5896) 2025-04-29 15:54:53 -07:00
Qiaolin Yu
8c0cfca87d Feat: support cuda graph for LoRA (#4115) 
Co-authored-by: Beichen Ma <mabeichen12@gmail.com>
 2025-04-28 23:30:44 -07:00
woodx
2c3ea29476 [Feature] support auto chat template (#4949) 2025-04-28 22:34:18 -07:00
Lianmin Zheng
26fc32d168 [CI] tune the test order to warmup the server (#5860) 2025-04-28 19:27:37 -07:00
Lianmin Zheng
849c83a0c0 [CI] test chunked prefill more (#5798) 2025-04-28 10:57:17 -07:00
Lianmin Zheng
daed453e84 [CI] Improve github summary & enable fa3 for more models (#5796) 2025-04-27 15:29:46 -07:00
Baizhou Zhang
f9fb33efc3 Add 8-GPU Test for Deepseek-V3 (#5691) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2025-04-27 12:46:12 -07:00
Lianmin Zheng
a38f6932cc [CI] Fix test case (#5790) 2025-04-27 08:55:35 -07:00
Lianmin Zheng
621e96bf9b [CI] Fix ci tests (#5769) 2025-04-27 07:18:10 -07:00
Lianmin Zheng
35ca04d2fa [CI] fix port conflicts (#5789) 2025-04-27 05:17:44 -07:00
Lianmin Zheng
3c4e0ee64d [CI] Tune threshold (#5787) 2025-04-27 04:10:22 -07:00
Lianmin Zheng
4d23ba08f5 Simplify FA3 tests (#5779) 2025-04-27 01:30:17 -07:00
Baizhou Zhang
a45a4b239d Split local attention test from fa3 test (#5774) 2025-04-27 01:03:31 -07:00
Lianmin Zheng
981a2619d5 Fix eagle test case (#5776) 2025-04-27 01:00:54 -07:00
Michał Moskal
bdbe5f816b update llguidance to 0.7.11; adds StructTag (#4870) 2025-04-26 20:13:57 -07:00
Stefan He
408ba02218 Add Llama 4 to FA3 test (#5509) 2025-04-26 19:49:31 -07:00
DavidBao
d8fbc7c096 [feature] support for roberta embedding models (#5730) 2025-04-26 18:47:06 -07:00
Mick
02723e1b0d CI: rewrite test_vision_chunked_prefill to speedup (#5682) 2025-04-26 18:33:13 -07:00
ZXN
04d0123fd9 [Fix]: support deepseek-vl2-tiny model (#5552) 
Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>
 2025-04-26 17:52:53 +08:00
Mick
feda9b11b3 fix: fix one more bug from merging mm_inputs (#5718) 
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: XinyuanTong <115166877+JustinTong0323@users.noreply.github.com>
 2025-04-25 17:28:33 -07:00
Lianmin Zheng
21514ff5bd Disable flaky eagle tests (#5753) 2025-04-25 15:54:39 -07:00
Ravi Theja
7d9679b74d Add MMMU benchmark results (#4491) 
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
 2025-04-25 15:23:53 +08:00
Mick
c998d04b46 vlm: enable radix cache for qwen-vl models (#5349) 
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
 2025-04-23 20:35:05 -07:00
Lianmin Zheng
de071366cd tune the threshold of gemma-2-27b-it in test_nightly_gsm8k_eval.py (#5677) 2025-04-23 05:31:17 -07:00
Yineng Zhang
8777a1d24b fix gemma3 unit test (#5670) 2025-04-23 02:14:01 -07:00
Zhiqiang Xie
70645f4d7d upstream hicache fixes (#5570) 2025-04-20 23:08:30 -07:00
Qingquan Song
188f0955fa Add Speculative Decoding Eagle3 topk > 1 (#5318) 
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Yubo Wang <yubowang2019@gmail.com>
 2025-04-20 22:58:28 -07:00
kyle-pena-kuzco
9f3bd2ad39 Feat: Implement JSON Mode (response_format.type="json_object") (#4733) 
Co-authored-by: Kyle Pena <kylepena@kyles-macbook-pro.turkey-marlin.ts.net>
 2025-04-20 17:41:22 -07:00
Adarsh Shirawalmath
8b39274e34 [Feature] Prefill assistant response - add continue_final_message parameter (#4226) 
Co-authored-by: Chayenne <zhaochen20@outlook.com>
 2025-04-20 17:37:18 -07:00
Baizhou Zhang
5156d5a413 Add test config yamls for Deepseek v3 (#5433) 2025-04-20 17:28:52 -07:00
Xiaoyu Zhang
bf86c5e990 restruct compressed_tensors_w8a8_fp8 (#5475) 2025-04-19 04:52:15 -07:00
woodx
3bface15e6 Feat/support encoder model (like bert) (#4887) 2025-04-17 01:50:48 -07:00
eigen
8f783c1943 [Model Support] unsloth/Phi-4-mini bnb model (#4982) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
 2025-04-16 19:58:20 -07:00
Lianmin Zheng
177320a582 Clean up imports (#5467) 2025-04-16 15:26:49 -07:00
Baizhou Zhang
a42736bbb8 Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113) 2025-04-15 22:01:22 -07:00
ryang
bc24205b32 Support BNB quantization for llama/mllama (#5038) 
Co-authored-by: Yuhao Yang <yyh073@foxmail.com>
 2025-04-15 18:00:31 -07:00
Chang Su
27a009bb00 Fix ignore_eos parameter when loading a chat template (#5264) 2025-04-15 17:09:45 -07:00
JieXin Liang
f88f7e1943 [misc] fix ci flaky case (#5352) 2025-04-15 01:37:16 -07:00
Yineng Zhang
ac5b78baf6 fix: update test config (#5392) 2025-04-14 17:39:47 -07:00
yhyang201
072df75354 Support for Qwen2.5-VL Model in bitsandbytes Format (#5003) 2025-04-14 02:03:40 -07:00
fzyzcjy
defede5073 Fix DeepSeek DP Attention + torch compile (#5367) 
Co-authored-by: ispobock <ispobaoke@163.com>
 2025-04-14 01:07:58 -07:00
Yineng Zhang
39d90449f3 feat: update experiment_runner (#5360) 2025-04-13 15:37:05 -07:00
tianlian yi
bc92107b03 Support server based rollout in Verlengine (#4848) 
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>
 2025-04-12 10:07:52 -07:00
Ke Bao
5ad0571903 Adjust ci test threshold (#5271) 2025-04-11 22:03:37 -07:00
Ke Bao
1078396f47 Update deps for mllama4 (#5215) 2025-04-10 09:12:44 -07:00
saienduri
7f875f1293 update grok test (#5171) 2025-04-09 11:09:47 -07:00
Mick
fbebcb7aa4 model: support mllama4 (#5144) 2025-04-09 09:28:44 -07:00
Xiaoyu Zhang
87eddedfa2 [ci] fix ci test fused_moe op (#5102) 2025-04-09 08:52:46 -07:00