EngineX-Hygon/sglang
5
0
Fork 0
Code Issues Pull Requests Actions 7 Projects Releases Wiki Activity
Files
1bdd010291e4878ad5768392ec6a7cf8acd79be9
sglang/python/sglang/srt/models
History
Cheng Wan 1bdd010291 Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
..
apertus.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
arcee.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
baichuan.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
bailing_moe_nextn.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
bailing_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
bert.py
Feat/support rerank (#6058)
2025-06-16 10:50:01 -07:00
chatglm.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
clip.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
commandr.py
Revert "fix some typos" (#6244)
2025-05-12 12:53:26 -07:00
dbrx.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
deepseek_janus_pro.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
deepseek_nextn.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
deepseek_v2.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
deepseek_vl2.py
[Refactor] simplify multimodal data processing (#8107)
2025-07-20 21:43:09 -07:00
deepseek.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
dots_ocr.py
Tiny move files to utils folder (#11166)
2025-10-03 22:40:06 +08:00
dots_vlm_vit.py
Replace pad with cat for better performance (#11388)
2025-10-10 12:03:17 +08:00
dots_vlm.py
model: support dots.vlm1 model (#8778)
2025-09-12 17:38:38 +08:00
ernie4_eagle.py
Add ernie4.py for ERNIE-4.5 (#7657)
2025-08-08 00:55:48 -07:00
ernie4.py
Refactor TopK to ensure readability and extensibility (#9338)
2025-09-14 19:16:25 -07:00
exaone.py
fix: EXAONE when using tie_word_embeddings (#5759)
2025-05-21 11:30:04 -07:00
falcon_h1.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
gemma2_reward.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
gemma2.py
Fix incorrect default get_hidden_dim logic (#8987)
2025-08-09 00:25:38 -07:00
gemma3_causal.py
Fix gemma 3 launch with transformers: the error: AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size' (#9614)
2025-09-29 06:18:29 +00:00
gemma3_mm.py
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
2025-10-06 17:23:00 -07:00
gemma3n_audio.py
chore: remove vlm unnecessary import (#7541)
2025-06-26 01:38:15 -07:00
gemma3n_causal.py
Updates Gemma3n MLP layer to adapt latest transformers version (#7573)
2025-06-26 15:07:22 -07:00
gemma3n_mm.py
Tiny move files to utils folder (#11166)
2025-10-03 22:40:06 +08:00
gemma.py
[Feature] Layer-wise Prefill (#7634)
2025-07-17 01:57:46 +08:00
glm4_moe_nextn.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
glm4_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
glm4.py
Support glm4.1v and glm4.5v (#8798)
2025-08-09 00:59:13 -07:00
glm4v_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
glm4v.py
Replace pad with cat for better performance (#11388)
2025-10-10 12:03:17 +08:00
gpt2.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
gpt_bigcode.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
gpt_oss.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
granite.py
Fix incorrect default get_hidden_dim logic (#8987)
2025-08-09 00:25:38 -07:00
granitemoe.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
grok.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
hunyuan.py
Support EPLB in FusedMoE (#8448)
2025-07-29 16:02:41 -07:00
idefics2.py
Fix incorrect LoRA weight loading for fused gate_up_proj (#6734)
2025-05-31 13:41:44 -07:00
internlm2_reward.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
internlm2.py
Support InternVL3 (#5350)
2025-05-01 22:38:59 -07:00
interns1.py
support for interns1-mini (#9299)
2025-08-18 17:56:04 -07:00
internvl.py
Support the internvl3.5 family models in sglang (#9705)
2025-09-02 22:06:48 +08:00
kimi_vl_moonvit.py
move more files under srt/utils (#11285)
2025-10-09 16:46:15 -07:00
kimi_vl.py
move more files under srt/utils (#11285)
2025-10-09 16:46:15 -07:00
llama4.py
support Llama4 with non uniformed intermediate size across layers for… (#10047)
2025-09-05 17:28:15 -07:00
llama_classification.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
llama_eagle3.py
Qwen2.5-VL eagle3 infer (#8801)
2025-09-07 20:44:34 -07:00
llama_eagle.py
[PP] Add pipeline parallelism (#5724)
2025-04-30 18:18:07 -07:00
llama_embedding.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
llama_reward.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
llama.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
llava.py
chore: bump transformer to 4.54.0 (#8416)
2025-07-27 21:27:25 -07:00
llavavid.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
longcat_flash_nextn.py
fix: remove awq_dequantize deps (#10686)
2025-09-20 01:47:01 -07:00
longcat_flash.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
mimo_mtp.py
Clean unused import for mimo mtp model (#7370)
2025-06-19 19:16:14 -07:00
mimo.py
Support XiaomiMiMo inference with mtp (#6059)
2025-05-22 14:14:49 -07:00
minicpm3.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
minicpm.py
fix: remove redundant rotary embedding cache recomputation in MiniCPM (#8022)
2025-07-15 00:12:45 -07:00
minicpmo.py
[chore][2/N] Avoid using default mutable parameters (#11479)
2025-10-12 20:34:04 +08:00
minicpmv.py
[model] support MiniCPM-V 4.0 (#8747)
2025-09-02 15:33:03 -07:00
mistral.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
mixtral_quant.py
[feature]Ascend quantization support (#7791)
2025-07-10 09:17:37 -07:00
mixtral.py
[8/N] MoE Refactor: deprecate EPMoE (#11211)
2025-10-07 21:51:41 -07:00
mllama4.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
mllama.py
Revert "[feature] Rework Ascend NPU graph support" (#9385)
2025-08-20 00:35:10 -07:00
nemotron_h.py
model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)
2025-10-09 00:37:38 +08:00
nemotron_nas.py
from python.sglang.srt -> from sglang.srt (#9268)
2025-08-17 02:45:45 -07:00
olmo2.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
olmo.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
olmoe.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
opt.py
Support opt model (#10165)
2025-09-09 12:45:00 +08:00
persimmon.py
Feat: Support for Persimmon Model (#7983)
2025-07-19 23:07:47 -07:00
phi3_small.py
Fix Phi3 serving which was broke by earlier change (#5991)
2025-05-03 00:28:47 -07:00
phi4mm_audio.py
Feat: Support audio in Phi4-mm model (#8048)
2025-07-18 21:03:53 -07:00
phi4mm_utils.py
Feat: Support audio in Phi4-mm model (#8048)
2025-07-18 21:03:53 -07:00
phi4mm.py
[CPU] Fix TP padding issue on Phi-4 (#8289)
2025-08-17 16:25:26 -07:00
phi.py
Support for Phi-1.5 & Phi-2 models (#7862)
2025-07-13 18:43:40 -07:00
phimoe.py
Support EPLB in FusedMoE (#8448)
2025-07-29 16:02:41 -07:00
pixtral.py
Refactor mm processors and Enable mixed modality processing (#7629)
2025-06-30 23:14:48 -07:00
qwen2_5_vl.py
Replace pad with cat for better performance (#11388)
2025-10-10 12:03:17 +08:00
qwen2_audio.py
Tiny move files to utils folder (#11166)
2025-10-03 22:40:06 +08:00
qwen2_classification.py
[Model] Support Qwen2ForSequenceClassification (#4609)
2025-03-24 19:13:44 -07:00
qwen2_eagle.py
[Bugfix] pipeline parallelism and Eagle Qwen2 (#6910)
2025-06-07 01:58:50 -07:00
qwen2_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
qwen2_rm.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00
qwen2_vl.py
Replace pad with cat for better performance (#11388)
2025-10-10 12:03:17 +08:00
qwen2.py
Revert "perf: optimize qwen-vl with symm mem allreduce" (#11436)
2025-10-10 12:30:05 -07:00
qwen3_classification.py
Add support for Qwen3-seq-cls (#9357)
2025-08-20 16:51:56 -07:00
qwen3_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
qwen3_next_mtp.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
qwen3_next.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
qwen3_vl_moe.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
qwen3_vl.py
[smol] [perf] Qwen3-VL in place op. (#11481)
2025-10-12 20:25:30 +08:00
qwen3.py
Use more general heuristics to set the default value of --mem-fraction-static (#10975)
2025-09-29 10:11:03 -07:00
qwen.py
[Feature] Layer-wise Prefill (#7634)
2025-07-17 01:57:46 +08:00
registry.py
[Auto Sync] Update registry.py (20250915) (#10484)
2025-09-15 17:34:28 -07:00
roberta.py
Feat/support rerank (#6058)
2025-06-16 10:50:01 -07:00
sarashina2_vision.py
model support: Sarashina2VisionForCausalLM (#10632)
2025-09-18 17:30:38 -07:00
siglip.py
Implement Siglip Vision model, and support BNB quantization for gemma3-mm (#5339)
2025-05-20 23:53:46 -07:00
solar.py
Remove wrong imports from sglang.python (#10493)
2025-09-15 22:12:21 -07:00
stablelm.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
starcoder2.py
model: support starcoder2 (#10609)
2025-10-04 00:11:19 +08:00
step3_vl.py
Revert "Deprecate global_server_args_dict" (#11520)
2025-10-12 17:40:40 -07:00
torch_native_llama.py
Fix multimodal registry and code sync scripts (#10759)
2025-09-22 15:36:01 -07:00
transformers.py
Small bug fix in transformers model implementation (#9809)
2025-08-29 18:51:44 -07:00
utils.py
EAGLE cache fix for SWARadixCache (#11231)
2025-10-07 18:21:37 +08:00
vila.py
refactor: unify names of the feature field of MultimodalDataItem (#8075)
2025-07-16 17:52:38 -07:00
xverse_moe.py
[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)
2025-08-14 21:14:53 -07:00
xverse.py
Fix loading KV quantization scale; Enable modelopt kv cache (#4686)
2025-04-08 09:11:35 -07:00
yivl.py
[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)
2025-03-05 01:11:00 -08:00