Ke Bao de5533341e Update Triton extend backend interface (#3309)

2025-02-05 18:12:22 +08:00

..

attention

Update Triton extend backend interface (#3309)

2025-02-05 18:12:22 +08:00

moe

[ROCm] Add tuning configs for AMD Radeon Graphics. (#3294)

2025-02-04 10:34:57 -08:00

quantization

[ROCm] Logic to decide whether to used manually unrolled kernel. (#3306)

2025-02-04 19:12:20 -08:00

activation.py

support QuickGELU (#3250)

2025-02-01 19:31:47 +08:00

dp_attention.py

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

layernorm.py

update and simplify CustomOp (#3249)

2025-02-01 18:56:44 +08:00

linear.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

logits_processor.py

Use int64 as indices for set_kv_buffer (#3039)

2025-01-21 19:46:09 -08:00

parameter.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Fix perf regression on small batch sizes (#3008)

2025-01-20 03:39:49 -08:00

rotary_embedding.py

update and simplify CustomOp (#3249)

2025-02-01 18:56:44 +08:00

sampler.py

Bug: Fix min_p sampling crash when using flashinfer backend (#3207)

2025-02-02 15:36:07 -08:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

feat: remove vllm distributed (#2907)

2025-01-17 22:31:51 +08:00