sglang

baichuan.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

chatglm.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

commandr.py

Enable Cohere2 Models (#3018 )

2025-01-20 19:21:41 -08:00

dbrx.py

enable kv_scale remap (#3017 )

2025-01-20 14:40:45 -08:00

deepseek_nextn.py

Support NextN (MTP) speculative decoding for DeepSeek-V3/R1 (#3582 )

2025-02-15 05:28:34 +08:00

deepseek_v2.py

[Feature]Support ragged prefill in flashinfer mla backend (#3967 )

2025-02-28 18:13:56 -08:00

deepseek.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

exaone.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

gemma2_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

gemma2.py

[Feature] SPMD for SGLang + Verl (#3852 )

2025-02-28 09:53:10 -08:00

gemma.py

[Feature] SPMD for SGLang + Verl (#3852 )

2025-02-28 09:53:10 -08:00

gpt2.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

gpt_bigcode.py

feat: remove vllm distributed (#2907 )

2025-01-17 22:31:51 +08:00

granite.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

grok.py

remove cache configs in model definitions (#4031 )

2025-03-03 05:00:50 -08:00

internlm2_reward.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

internlm2.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

llama_classification.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama_eagle.py

remove cache configs in model definitions (#4031 )

2025-03-03 05:00:50 -08:00

llama_embedding.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

llama_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

llava.py

doc: emphasize and notify the usage of chat_template (#3589 )

2025-02-15 00:10:32 -08:00

llavavid.py

[Bug]: Add missing clamp to llavavid (#3787 )

2025-02-24 19:10:15 -08:00

minicpm3.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

minicpm.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

minicpmv.py

[Fix] Address remaining issues of supporting MiniCPMV (#2977 )

2025-01-28 00:22:13 -08:00

mistral.py

docs: fix module docstrings and copyright headers (#2077 )

2024-11-22 22:16:53 +08:00

mixtral_quant.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

mixtral.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

mllama.py

[Fix] Address remaining issues of supporting MiniCPMV (#2977 )

2025-01-28 00:22:13 -08:00

olmo2.py

Improve: Tiny fix Olmo2 (#3348 )

2025-02-21 16:09:35 -08:00

olmo.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

olmoe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

phi3_small.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

qwen2_5_vl.py

Model: Support Qwen 2.5 vl (#3258 )

2025-02-16 00:58:53 -08:00

qwen2_eagle.py

remove cache configs in model definitions (#4031 )

2025-03-03 05:00:50 -08:00

qwen2_moe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

qwen2_rm.py

Bug: fix lm head weights in Qwen models (#3777 )

2025-02-21 16:49:31 -08:00

qwen2_vl.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

qwen2.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

qwen.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

registry.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

stablelm.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

torch_native_llama.py

Bug: Fix weight loader error when LM head weights are tied (#3766 )

2025-02-21 17:53:12 -08:00

xverse_moe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

xverse.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

yivl.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00