sglang

baichuan.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

chatglm.py

Remove vllm dependency in model config (#2809 )

2025-01-09 17:51:56 +08:00

commandr.py

Add more support for intel Gaudi accelerators (#2357 )

2024-12-06 01:16:33 -08:00

dbrx.py

Remove vllm dependency in model config (#2809 )

2025-01-09 17:51:56 +08:00

deepseek_v2.py

AMD DeepSeek_V3 FP8 Numerical fix (#2667 )

2024-12-30 21:31:12 +08:00

deepseek.py

Reorg moe code (#2563 )

2024-12-24 01:10:22 +08:00

exaone.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

gemma2_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

gemma2.py

Error occurs when loading the gemma model in bitsandbytes format. (#2557 )

2024-12-26 05:10:37 -08:00

gemma.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

gpt2.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

gpt_bigcode.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

granite.py

Add support for IBM Granite 3.x models (#2437 )

2024-12-11 06:30:23 -08:00

grok.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784 )

2025-01-07 23:29:10 -08:00

internlm2_reward.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

internlm2.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

llama_classification.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama_eagle.py

Add llama_eagle.py (#2640 )

2024-12-29 01:45:35 -08:00

llama_embedding.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

llama_reward.py

[Minor] Improve code style (#2422 )

2024-12-09 06:30:35 -08:00

llama.py

feat: support internlm 3 dense (#2888 )

2025-01-14 19:23:26 +08:00

llava.py

[feat] Enable chunked prefill for llava-onevision (#2412 )

2024-12-09 09:52:38 -08:00

llavavid.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

minicpm3.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

minicpm.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

mistral.py

docs: fix module docstrings and copyright headers (#2077 )

2024-11-22 22:16:53 +08:00

mixtral_quant.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

mixtral.py

Reorg moe code (#2563 )

2024-12-24 01:10:22 +08:00

mllama.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

olmo2.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

olmo.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

olmoe.py

Reorg moe code (#2563 )

2024-12-24 01:10:22 +08:00

phi3_small.py

move apply_torchao_config_ to model_runner (#2342 )

2024-12-04 17:26:42 -08:00

qwen2_eagle.py

add qwen2 eagle model (#2863 )

2025-01-13 05:29:33 -08:00

qwen2_moe.py

Reorg moe code (#2563 )

2024-12-24 01:10:22 +08:00

qwen2_vl.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

qwen2.py

add qwen2 eagle model (#2863 )

2025-01-13 05:29:33 -08:00

qwen.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

registry.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

stablelm.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

torch_native_llama.py

move apply_torchao_config_ to model_runner (#2342 )

2024-12-04 17:26:42 -08:00

xverse_moe.py

Reorg moe code (#2563 )

2024-12-24 01:10:22 +08:00

xverse.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00

yivl.py

Update model_loader deps and qqq quantization deps (#2220 ) (#2318 )

2024-12-02 23:22:13 +08:00