sglang

baichuan.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

chatglm.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

commandr.py

Enable Cohere2 Models (#3018 )

2025-01-20 19:21:41 -08:00

dbrx.py

enable kv_scale remap (#3017 )

2025-01-20 14:40:45 -08:00

deepseek_v2.py

feat: use sgl-kernel 0.0.3 in sglang (#3179 )

2025-01-27 21:39:52 +08:00

deepseek.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

exaone.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

gemma2_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

gemma2.py

enable kv_scale for Gemma2 (#3113 )

2025-01-25 18:29:14 -08:00

gemma.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

gpt2.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

gpt_bigcode.py

feat: remove vllm distributed (#2907 )

2025-01-17 22:31:51 +08:00

granite.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

grok.py

Add activation parameters to fused_moe (#3170 )

2025-01-27 00:23:37 -08:00

internlm2_reward.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

internlm2.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

llama_classification.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama_eagle.py

Add llama_eagle.py (#2640 )

2024-12-29 01:45:35 -08:00

llama_embedding.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

llama_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama.py

Feature: Fix the binding error in Llama (#3355 )

2025-02-06 20:19:24 -08:00

llava.py

[feat] Enable chunked prefill for llava-onevision (#2412 )

2024-12-09 09:52:38 -08:00

llavavid.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

minicpm3.py

feat: use sgl-kernel 0.0.3 in sglang (#3179 )

2025-01-27 21:39:52 +08:00

minicpm.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

minicpmv.py

[Fix] Address remaining issues of supporting MiniCPMV (#2977 )

2025-01-28 00:22:13 -08:00

mistral.py

docs: fix module docstrings and copyright headers (#2077 )

2024-11-22 22:16:53 +08:00

mixtral_quant.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

mixtral.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

mllama.py

[Fix] Address remaining issues of supporting MiniCPMV (#2977 )

2025-01-28 00:22:13 -08:00

olmo2.py

fix deepseek v2 with cpu device (#2975 )

2025-01-19 21:33:27 +08:00

olmo.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

olmoe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

phi3_small.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

qwen2_eagle.py

add qwen2 eagle model (#2863 )

2025-01-13 05:29:33 -08:00

qwen2_moe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

qwen2_vl.py

support QuickGELU (#3250 )

2025-02-01 19:31:47 +08:00

qwen2.py

[Fix] Address remaining issues of supporting MiniCPMV (#2977 )

2025-01-28 00:22:13 -08:00

qwen.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

registry.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

stablelm.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

torch_native_llama.py

Support loading of larger models with on-the-fly quantization (#3061 )

2025-01-22 21:33:17 -08:00

xverse_moe.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

xverse.py

feat: remove vllm get_rope (#2964 )

2025-01-18 19:38:01 +08:00

yivl.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00