Lianmin Zheng 8b6ce52e92 Support multi-node DP attention (#2925) ...

Co-authored-by: dhou-xai <dhou@x.ai>

2025-01-16 11:15:00 -08:00

..

attention

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

moe

Unify sglang coding style (#2856)

2025-01-13 02:12:44 -08:00

quantization

feat: patch linear base (#2915)

2025-01-16 18:00:03 +08:00

activation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

dp_attention.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

layernorm.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

linear.py

feat: patch linear base (#2915)

2025-01-16 18:00:03 +08:00

logits_processor.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

parameter.py

Fix linear.py and improve weight loading (#2851)

2025-01-13 01:39:14 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Support FP8 E4M3 KV Cache (#2786)

2025-01-12 21:17:11 -08:00

rotary_embedding.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampler.py

Minor follow-up fixes for the logprob refactor (#2670)

2024-12-30 05:42:08 -08:00

torchao_utils.py

Add GemLite caching after each capture (#2669)

2024-12-30 05:27:29 -08:00

vocab_parallel_embedding.py

Fix linear.py and improve weight loading (#2851)

2025-01-13 01:39:14 -08:00