Add local kv cache store for vllm - #2063

Add local kv cache store for vllm#2063

vegetableysm wants to merge 2 commits into

v6d-io:mainv6d-io/v6d:mainfrom

vegetableysm:kvsvegetableysm/v6d:kvsCopy head branch name to clipboard