Yineng Zhang 7811bfdaa7 compatible with flashinfer v0.2 (#3235)

2025-02-01 01:32:18 +08:00

..

attention

compatible with flashinfer v0.2 (#3235)

2025-02-01 01:32:18 +08:00

moe

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

quantization

Fix block wise fp8 torch compile (#3232)

2025-01-31 19:56:02 +08:00

activation.py

feat: use sgl-kernel 0.0.3 in sglang (#3179)

2025-01-27 21:39:52 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

dp_attention.py

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

layernorm.py

feat: use sgl-kernel 0.0.3 in sglang (#3179)

2025-01-27 21:39:52 +08:00

linear.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

logits_processor.py

Use int64 as indices for set_kv_buffer (#3039)

2025-01-21 19:46:09 -08:00

parameter.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Fix perf regression on small batch sizes (#3008)

2025-01-20 03:39:49 -08:00

rotary_embedding.py

[kernel] Use sgl_kernel rope (#3169)

2025-01-28 14:33:11 +08:00

sampler.py

[fix] Clamp logprob with dtype min to prevent -inf (#3224)

2025-01-31 17:04:04 +08:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

feat: remove vllm distributed (#2907)

2025-01-17 22:31:51 +08:00