Skip to content

vllm.v1.kv_offload.cpu.common

CPULoadStoreSpec

Bases: BlockIDsLoadStoreSpec

Spec for loading/storing a KV block to CPU memory.

Source code in vllm/v1/kv_offload/cpu/common.py 
 6
 7
 8
 9
10
11
12
13
class CPULoadStoreSpec(BlockIDsLoadStoreSpec):
    """
    Spec for loading/storing a KV block to CPU memory.
    """

    @staticmethod
    def medium() -> str:
        return "CPU"