1
vllm_ascend/simple_kv_offload/__init__.py
Normal file
1
vllm_ascend/simple_kv_offload/__init__.py
Normal file
@@ -0,0 +1 @@
|
||||
"""NPU adaptation of vLLM's simple CPU KV-cache offloading."""
|
||||
Reference in New Issue
Block a user