Ximingwang-09 0f2a2e3c19 Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220) ...

Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>

2025-03-11 12:32:33 -07:00

..

N=256,K=7168,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=256,K=7168,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=256,K=7168,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=256,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=256,K=7168,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=512,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=512,K=7168,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=512,K=7168,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=512,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=512,K=7168,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=512,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=576,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=576,K=7168,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=576,K=7168,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=576,K=7168,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=576,K=7168,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=576,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=576,K=7168,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=576,K=7168,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=576,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=576,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=576,K=7168,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=1536,K=1536,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=1536,K=1536,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=1536,K=1536,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=1536,K=1536,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=1536,K=1536,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=1536,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=1536,K=7168,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=1536,K=7168,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=1536,K=7168,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=1536,K=7168,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=1536,K=7168,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=1536,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=1536,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=1536,K=7168,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=2048,K=512,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=2048,K=512,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=2048,K=512,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=2048,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=2048,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=2048,K=512,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=2304,K=7168,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=2304,K=7168,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=2304,K=7168,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=2304,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=2304,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=2304,K=7168,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=3072,K=1536,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=3072,K=1536,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=3072,K=1536,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=3072,K=1536,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=3072,K=1536,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=3072,K=1536,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=3072,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=3072,K=7168,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=3072,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=3072,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=4096,K=512,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=4096,K=512,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=4096,K=512,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=4096,K=512,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=4096,K=512,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=4096,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=4096,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=4608,K=7168,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=4608,K=7168,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=4608,K=7168,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=4608,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=4608,K=7168,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=4608,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=4608,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=128,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=7168,K=128,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=7168,K=128,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=7168,K=128,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=128,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=7168,K=256,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=7168,K=256,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=7168,K=256,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=7168,K=256,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=7168,K=256,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=7168,K=256,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=1024,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=7168,K=1024,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=7168,K=1024,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=7168,K=1024,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=1024,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=1024,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=7168,K=1152,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=7168,K=1152,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=7168,K=1152,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=7168,K=1152,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=1152,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=1152,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=7168,K=2048,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=7168,K=2048,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=7168,K=2048,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=7168,K=2048,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=7168,K=2048,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=7168,K=2048,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=2048,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=2304,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

add dsv3 mi300 triton config for block scale (#3146)

2025-01-27 17:25:53 +08:00

N=7168,K=2304,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning configs for AMD Instinct MI325X. (#3536)

2025-02-12 20:09:36 -08:00

N=7168,K=2304,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add ROCm tuning config to block gemm and Re-tune for AMD Radeon Graphics (#3418)

2025-02-10 23:55:04 -08:00

N=7168,K=2304,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=7168,K=2304,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=7168,K=2304,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=2304,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=16384,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=7168,K=16384,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=7168,K=16384,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=7168,K=16384,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=7168,K=16384,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=7168,K=16384,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=7168,K=16384,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=7168,K=16384,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=7168,K=16384,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=16384,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=16384,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=7168,K=18432,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=7168,K=18432,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=7168,K=18432,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=7168,K=18432,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=7168,K=18432,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=7168,K=18432,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=18432,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=7168,K=18432,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=24576,K=1536,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=24576,K=1536,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=24576,K=1536,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=24576,K=7168,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=24576,K=7168,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=24576,K=7168,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=24576,K=7168,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=24576,K=7168,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=24576,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=24576,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=24576,K=7168,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=32768,K=512,device_name=AMD_Instinct_MI300X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=32768,K=512,device_name=AMD_Instinct_MI325X,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=32768,K=512,device_name=AMD_Radeon_Graphics,dtype=fp8_w8a8,block_shape=[128, 128].json

[ROCm] Add additional block quant GEMM tuning configs for AMD GPUs. (#3616)

2025-02-17 15:54:18 -08:00

N=32768,K=512,device_name=NVIDIA_A100-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

N=32768,K=512,device_name=NVIDIA_A800-SXM4-80GB,dtype=int8_w8a8,block_shape=[128, 128].json

Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)

2025-03-11 00:32:25 -07:00

N=32768,K=512,device_name=NVIDIA_B200,dtype=fp8_w8a8,block_shape=[128, 128].json

adding Triton configs for DeepSeekV3 on Blackwell (#3272)

2025-02-04 04:12:09 +08:00

N=32768,K=512,device_name=NVIDIA_H20,dtype=fp8_w8a8,block_shape=[128, 128].json

Add H20 fp8 w8a8 gemm config (#3386)

2025-02-08 15:36:31 +08:00

N=32768,K=512,device_name=NVIDIA_H20,dtype=int8_w8a8,block_shape=[128, 128].json

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

N=32768,K=512,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=32768,K=512,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=32768,K=512,device_name=NVIDIA_L20Y,dtype=fp8_w8a8,block_shape=[128, 128].json

support multi-gpu block-gemm tuning (#3639)

2025-02-18 00:00:35 +08:00

N=36864,K=7168,device_name=NVIDIA_H100_80GB_HBM3,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00

N=36864,K=7168,device_name=NVIDIA_H200,dtype=fp8_w8a8,block_shape=[128, 128].json

Update Triton configs for block fp8 kernels (#2641)

2024-12-29 22:53:47 +08:00