[Bugfix] fix TransposeKvCacheByBlock op error report in plog (#7235)
### What this PR does / why we need it? As issue #7201 reported, there are some TransposeKvCacheByBlock operation related ERRORs in plog when vllm launching, though it doesn't influence the running of vllm, but ERRORs will be very confused in debug, this PR fixed the problem as suggested. ### Does this PR introduce _any_ user-facing change? no. ### How was this patch tested? - vLLM version: v0.17.0 - vLLM main: https://github.com/vllm-project/vllm/commit/4034c3d32e30d01639459edd3ab486f56993876d Signed-off-by: lidenghui <lidenghui1110@gmail.com>
This commit is contained in:
1 parent
3f39ac9c8d
commit
4e62a2ae15
1 file changed
+3
-3
@@ -17,9 +17,9 @@ public:
|
||||
.UnknownShapeFormat({ge::FORMAT_ND, ge::FORMAT_ND});
|
||||
this->Input("blockIDs")
|
||||
.ParamType(REQUIRED)
|
||||
.DataTypeList({ge::DT_INT64})
|
||||
.FormatList({ge::FORMAT_ND})
|
||||
.UnknownShapeFormat({ge::FORMAT_ND});
|
||||
.DataType({ge::DT_INT64, ge::DT_INT64})
|
||||
.Format({ge::FORMAT_ND, ge::FORMAT_ND})
|
||||
.UnknownShapeFormat({ge::FORMAT_ND, ge::FORMAT_ND});
|
||||
this->Attr("blockSize").Int();
|
||||
this->Attr("headNum").Int();
|
||||
this->Attr("headDim").Int();
|
||||
|
||||
Reference in new issue
Block a user