Qubitium-ModelCloud 87f671ab58 Fix debug_tensor_dump_output_folder optional key missing (#4046)

2025-03-04 03:42:48 -08:00

..

attention

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

moe

ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant) (#4053)

2025-03-04 03:00:46 -08:00

quantization

ROCm: update aiter and its usage to fused moe (bloat16, fp8, fp8 block-quant) (#4053)

2025-03-04 03:00:46 -08:00

activation.py

support QuickGELU (#3250)

2025-02-01 19:31:47 +08:00

dp_attention.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

layernorm.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

linear.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

logits_processor.py

Fix debug_tensor_dump_output_folder optional key missing (#4046)

2025-03-04 03:42:48 -08:00

parameter.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Fix perf regression on small batch sizes (#3008)

2025-01-20 03:39:49 -08:00

rotary_embedding.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

sampler.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00