Neo 0ca594eda9 [FIX]remove redundant code in logits_processor.py (#7079)

2025-06-11 11:49:30 -07:00

..

attention

vlm: adapt internvl to VisionAttention (#6870)

2025-06-11 01:16:04 -07:00

moe

Update default settings for blackwell (#7023)

2025-06-09 20:37:47 -07:00

quantization

Clean up server_args.py (#7037)

2025-06-10 05:34:29 -07:00

activation.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

communicator.py

Revert "fix communicator for non-dp lm head (#6662)" (#6677)

2025-05-27 12:22:59 -07:00

dp_attention.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

AITER backend extension and workload optimizations (#6838)

2025-06-05 23:00:18 -07:00

linear.py

Fix GGuf and add back test_gguf.py (#7067)

2025-06-10 21:07:20 -07:00

logits_processor.py

[FIX]remove redundant code in logits_processor.py (#7079)

2025-06-11 11:49:30 -07:00

multimodal.py

chore: upgrade flashinfer v0.2.6.post1 jit (#6958)

2025-06-09 09:22:39 -07:00

parameter.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

pooler.py

[feature] support for roberta embedding models (#5730)

2025-04-26 18:47:06 -07:00

radix_attention.py

Fuse MLA set kv cache kernel (#5748)

2025-04-26 18:42:22 -07:00

rotary_embedding.py

[fix] recover auto-dispatch for rmsnorm and rope (#6745)

2025-06-03 21:44:20 -07:00

sampler.py

Slightly improve the sampler to skip unnecessary steps (#6956)

2025-06-08 03:18:54 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

utils.py

[Feature] Support Flashinfer fmha on Blackwell (#6930)

2025-06-06 12:57:50 -07:00

vocab_parallel_embedding.py

Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558)

2025-05-11 23:36:29 -07:00