Hubert Lu 7750b91ca8 [AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661)

2025-07-18 14:27:25 -07:00

..

compressed_tensors

fix compressed tensors WNA16 imports (#8142)

2025-07-18 11:34:14 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

deep_gemm_wrapper

[fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247)

2025-06-16 11:45:54 -07:00

__init__.py

[3/n] chore: decouple AWQ implementation from vLLM dependency (#8113)

2025-07-18 11:45:22 -07:00

awq_triton.py

[AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661)

2025-07-18 14:27:25 -07:00

awq.py

[AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661)

2025-07-18 14:27:25 -07:00

base_config.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

blockwise_int8.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

fp8_kernel.py

Fix CI xeon test with triton 3.3.1 (#8086)

2025-07-16 02:12:23 -07:00

fp8_utils.py

[Dockerfile] Multi-arch support for ROCm (#7902)

2025-07-14 06:13:09 +00:00

fp8.py

[CPU][Llama4] Fix Llama4 MoE inputs with "apply_router_weight_on_input" (#7889)

2025-07-17 21:43:25 -07:00

gptq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

int8_kernel.py

[2/2] Support Qserve (#6521)

2025-05-23 12:39:18 -07:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

kv_cache.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

marlin_utils.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

modelopt_quant.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

moe_wna16.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

scalar_type.py

[1/n] chore: decouple quantization implementation from vLLM dependency (#7992)

2025-07-16 15:56:26 -07:00

unquant.py

[Quantization][w8a8_int8] Fix weight loading issue for w8a8_int8 path with "ignore" layer list in quantization config (#7820)

2025-07-17 22:03:56 -07:00

utils.py

[3/n] chore: decouple AWQ implementation from vLLM dependency (#8113)

2025-07-18 11:45:22 -07:00

w4afp8.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

w8a8_fp8.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

w8a8_int8.py

[Bugfix] Fix w8a8_int8 import error on NPU (#8147)

2025-07-18 11:34:55 -07:00