Yineng Zhang fa909dc3c4 feat: update model_specific_adjustment (#5344) ...

Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>

2025-04-15 14:45:15 -07:00

..

attention

feat: update model_specific_adjustment (#5344)

2025-04-15 14:45:15 -07:00

moe

Add H20 dtype fp8_w8a8 shared experts fused MoE kernel tuning configs for DeepSeek V3/R1 (#5291)

2025-04-14 18:40:31 -07:00

quantization

[Fix] Turn off DeepGEMM by default (#5263)

2025-04-14 17:45:44 -07:00

activation.py

cleanup deps 2/n (#4464)

2025-03-15 23:06:17 -07:00

dp_attention.py

Fix DeepSeek DP Attention + torch compile (#5367)

2025-04-14 01:07:58 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

Urgent model support: support gemma-3-it (#4424)

2025-03-16 17:37:32 -07:00

linear.py

FP4 weight loading and inference (2/2) (#3972)

2025-04-08 17:26:21 -07:00

logits_processor.py

Reduce computation and communication in DP attention (#4521)

2025-03-18 13:41:36 -07:00

parameter.py

[Feature] Integrate DeepEP into SGLang (#4232)

2025-03-19 08:16:31 -07:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Fix loading KV quantization scale; Enable modelopt kv cache (#4686)

2025-04-08 09:11:35 -07:00

rotary_embedding.py

Tiny fix DeepseekScalingRotaryEmbedding always use forward_native (#5406)

2025-04-15 01:33:47 -07:00

sampler.py

Remove redundant type conversion (#4513)

2025-03-17 05:57:35 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

Clean up fp8 support (#4230)

2025-03-09 21:46:35 -07:00