Repository navigation
feat: CON-1146: Add more graceful error handling - #337
Merged
velaraptor-runpod merged 1 commit intoSep 10, 2026
Merged
velaraptor-runpod merged 1 commit into
velaraptor-runpod merged 1 commit into
Conversation
velaraptor-runpod
self-requested a review
September 8, 2026 19:00
velaraptor-runpod
added a commit
that referenced
this pull request
Sep 10, 2026
Cloudflare now bans the default Python-urllib UA with HTTP 403 (error code 1010), which broke the serverless e2e job for every PR today (this one and #337). A browser UA passes.
Contributor
|
Can you add this header in the serveless_e2e_test. You can look at this PR, or better just merge that branch here: #338. Just so we properly test it. |
velaraptor-runpod
requested changes
Sep 10, 2026
velaraptor-runpod
left a comment
Contributor
There was a problem hiding this comment.
Refer to comment above.
OWCramer
force-pushed
the
owen/con-1146-serverless-oom-vllm-workers-crash-loop-on-startup-cuda-oom
branch
from
September 10, 2026 20:18
34e41bb to
3de69dc
Compare
velaraptor-runpod
approved these changes
Sep 10, 2026
velaraptor-runpod
deleted the
owen/con-1146-serverless-oom-vllm-workers-crash-loop-on-startup-cuda-oom
branch
September 10, 2026 21:04
Promptless documentation updates
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Currently when the worker runs into an issue such as an OOM the process silently dies, the worker goes unhealthy, and the user gets confused. The changes in this PR catch those error and send the error to the user via the standard output. So instead of getting confused and tryign to filter through logs, the request instead comes back with an OOM error.
This approach mirrors implementations from this org's vllm-omni repo and ollama repo.