Files
enginex-ascend-910-vllm/vllm_ascend/simple_kv_offload/__init__.py

2 lines
63 B
Python
Raw Normal View History

"""NPU adaptation of vLLM's simple CPU KV-cache offloading."""