Hubert Lu 2c562fd2d0 Fix Llama 4 with MXFP4 dynamic quant on MI35x (#9993)

2025-09-04 00:48:58 -07:00

..

compressed_tensors

[AMD] Fix Llama 4 FP8 accuracy issues on MI300X (#7699)

2025-08-22 13:13:45 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

deep_gemm_wrapper

Revert "[Fix] DeepSeek EP accuracy issue on B200 GPUs (#9946)" (#9955)

2025-09-02 23:49:56 -07:00

quark

Revert "Optimized deepseek-v3/r1 model performance on mxfp4 run (#9671)" (#9959)

2025-09-03 00:50:04 -07:00

__init__.py

fix: support fb fp8 (#9462)

2025-08-21 14:31:43 -07:00

awq_triton.py

[AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661)

2025-07-18 14:27:25 -07:00

awq.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

base_config.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

blockwise_int8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

fp8_kernel.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340)

2025-08-27 12:01:30 -07:00

fp8_utils.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340)

2025-08-27 12:01:30 -07:00

fp8.py

move is_sm90_supported/is_sm100_supported to python/sglang/srt/utils.py (#9679)

2025-08-27 03:34:29 -07:00

fpgemm_fp8.py

fix: support fb fp8 (#9462)

2025-08-21 14:31:43 -07:00

gptq.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

int8_kernel.py

[2/2] Support Qserve (#6521)

2025-05-23 12:39:18 -07:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

kv_cache.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

marlin_utils_fp8.py

[5/n]decouple quantization implementation from vLLM dependency (#9454)

2025-08-21 12:52:07 -07:00

marlin_utils.py

[5/n]decouple quantization implementation from vLLM dependency (#9454)

2025-08-21 12:52:07 -07:00

modelopt_quant.py

Qwen FP8/NVFP4 ModelOPT Quantization support (#7912)

2025-09-02 20:56:03 -07:00

moe_wna16.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

mxfp4_tensor.py

[sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340)

2025-08-27 12:01:30 -07:00

mxfp4.py

Fix Llama 4 with MXFP4 dynamic quant on MI35x (#9993)

2025-09-04 00:48:58 -07:00

petit_utils.py

Support NVFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#7302)

2025-07-18 19:59:39 -07:00

petit.py

[fix] fix modelopt fp4 on b200 (#8195)

2025-07-20 17:39:57 -07:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

unquant.py

[CPU] Fix TP padding issue on Phi-4 (#8289)

2025-08-17 16:25:26 -07:00

utils.py

[Model] Support Meituan LongCat-Flash && LongCat-Flash-MTP (#9824)

2025-08-30 23:29:21 -07:00

w4afp8.py

[feat] Support tp mode for DeepSeek-R1-W4AFP8 (#8118)

2025-09-01 22:17:26 -07:00

w8a8_fp8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

w8a8_int8.py

[Feature] Support NPUGraph for DeepSeek on Ascend NPU (#9355)

2025-08-28 16:06:24 -07:00