Chang Su f04c80dc42 Add Llama4 support (#5092) ...

Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

2025-04-07 00:29:36 -07:00

..

compressed_tensors

Add DeepSeek V3/R1 shared experts fusion (#4918)

2025-04-04 01:59:29 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

__init__.py

Add Llama4 support (#5092)

2025-04-07 00:29:36 -07:00

awq.py

Clean up import vllm in quantization/__init__.py (#4834)

2025-03-28 10:34:10 -07:00

base_config.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

blockwise_int8.py

Add Llama4 support (#5092)

2025-04-07 00:29:36 -07:00

fp8_kernel.py

Clean up import vllm in quantization/__init__.py (#4834)

2025-03-28 10:34:10 -07:00

fp8_utils.py

sgl scaled_fp8_quant support output padding (#4861)

2025-04-02 23:53:57 +08:00

fp8.py

Add Llama4 support (#5092)

2025-04-07 00:29:36 -07:00

gptq.py

Clean up import vllm in quantization/__init__.py (#4834)

2025-03-28 10:34:10 -07:00

int8_kernel.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

kv_cache.py

sglang quant module remove vllm dependency (#4507)

2025-03-17 15:51:59 -07:00

modelopt_quant.py

sglang quant module remove vllm dependency (#4507)

2025-03-17 15:51:59 -07:00

moe_wna16.py

Add Llama4 support (#5092)

2025-04-07 00:29:36 -07:00

utils.py

[2/3] fix dsv3 awq issue (#4625)

2025-04-03 17:36:39 -07:00

w8a8_fp8.py

fix: fix typo of comments in w8a8_fp8.py (#4843)

2025-03-27 21:06:47 -07:00

w8a8_int8.py

Add Llama4 support (#5092)

2025-04-07 00:29:36 -07:00