Lianmin Zheng 6406408a70 Clean up server_args.py (#7037)

2025-06-10 05:34:29 -07:00

..

compressed_tensors

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

__init__.py

chore: upgrade flashinfer v0.2.6.post1 jit (#6958)

2025-06-09 09:22:39 -07:00

awq.py

fix awq_dequantize import (#5669)

2025-04-23 01:36:26 -07:00

base_config.py

Support compressed tensors fp8w8a8 (#4743)

2025-03-26 13:21:25 -07:00

blockwise_int8.py

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00

deep_gemm.py

Clean up server_args.py (#7037)

2025-06-10 05:34:29 -07:00

fp8_kernel.py

refactor apply_w8a8_block_fp8_linear in fp (#6545)

2025-05-29 00:15:11 -07:00

fp8_utils.py

[Feature] Support Flashinfer fmha on Blackwell (#6930)

2025-06-06 12:57:50 -07:00

fp8.py

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00

gptq.py

[QuickFix] fix gptq model initialize (#6429)

2025-05-19 21:17:10 -07:00

int8_kernel.py

[2/2] Support Qserve (#6521)

2025-05-23 12:39:18 -07:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

kv_cache.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

modelopt_quant.py

[DeepseekR1-FP4] Add Support for nvidia/DeepSeekR1-FP4 model (#6853)

2025-06-07 17:24:35 -07:00

moe_wna16.py

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00

qoq.py

[2/2] Support Qserve (#6521)

2025-05-23 12:39:18 -07:00

utils.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

w8a8_fp8.py

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00

w8a8_int8.py

Fuse routed scaling factor in deepseek (#6970)

2025-06-08 15:24:24 -07:00