Auto-retry startup OOM once with a reduced memory footprint - #346

Auto-retry startup OOM once with a reduced memory footprint#346

velaraptor-runpod merged 1 commit into

mainrunpod-workers/worker-vllm:mainfrom

feature/oom-startup-retryrunpod-workers/worker-vllm:feature/oom-startup-retryCopy head branch name to clipboard