dc99cfdc15
### What this PR does / why we need it?
To support tensorList for dispatch_ffn_combine, to adjust eplb
### Does this PR introduce _any_ user-facing change?
N/A
### How was this patch tested?
Single Operator Testing
- vLLM version: v0.13.0
- vLLM main:
2f4e6548ef
---------
Signed-off-by: lhchg <lhao_cheng@163.com>
Co-authored-by: lihaocheng <lihaosheng1@h-partners.com>
8 lines
237 B
C++
8 lines
237 B
C++
|
|
#ifndef CONST_ARGS_HPP
|
|
#define CONST_ARGS_HPP
|
|
constexpr static uint64_t MB_SIZE = 1024 * 1024UL;
|
|
constexpr static int32_t NUMS_PER_FLAG = 16;
|
|
constexpr static int32_t CACHE_LINE = 512;
|
|
constexpr static int32_t RESET_VAL = 0xffff;
|
|
#endif |