6852a2e267
### What this PR does / why we need it?
LMCache-Ascend is LMCache's solution on the Ascend platform and one of
the KVCache pooling solutions for Ascend. We hope to integrate
LMCache-Ascend into the vLLM-Ascend community as one of the official
KVCache pooling solutions for vLLM-Ascend.
We added a new LMCacheAscendConnector in vLLM-Ascend and registered it.
### Does this PR introduce _any_ user-facing change?
Users can specify the kvconnector using `--kv-transfer-config`, allowing
them to freely choose which kvconnector to use, without any user-facing
change.
### How was this patch tested?
Test by specifying `--kv-transfer-config
'{"kv_connector":"LMCacheAscendConnector","kv_role":"kv_both"}'`
- vLLM version: v0.16.0
- vLLM main:
15d76f74e2
---------
Signed-off-by: chloroethylene <jjysama@gmail.com>
43 lines
824 B
INI
43 lines
824 B
INI
[mypy]
|
|
; warn_return_any = True
|
|
warn_unused_configs = True
|
|
; disable errors about unchecked annotations for now.
|
|
disable_error_code = annotation-unchecked
|
|
|
|
; Suppress all missing import errors from torch_npu for mypy.
|
|
[mypy-torch_npu.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-torchair.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-transformers.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-lm_eval.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-compressed_tensors.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-datasets.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-llmcompressor.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-msprobe.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-xlite.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-ucm.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-msmodelslim.*]
|
|
ignore_missing_imports = True
|
|
|
|
[mypy-lmcache_ascend.*]
|
|
ignore_missing_imports = True
|