Skip to content

fix: raise hedge-order gate reconciliation timeout to 60s #1585

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ueco-jb wants to merge 2 commits into from
Closed

fix: raise hedge-order gate reconciliation timeout to 60s #1585

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f5d91ad
Raise hedge-order gate reconciliation timeout to 60s in prod and staging
ueco-jb Sep 30, 2026
3f900a4
Clarify that the 10s deadline aborted only the offchain inventory poll
ueco-jb Sep 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 6 additions & 4 deletions config/prod/st0x-hedge.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,12 @@ apalis_finished_job_cleanup_interval_secs = 3600
# Hedging balance for a symbol before the poller escalates a forced snapshot
# reconciliation.
inventory_divergence_threshold = 10
# Master schema field, unknown to v1.10.0 (the 2026-09-04 crash loop was
# this line landing in production ahead of the image; the release-time
# validator now refuses that). Ships with the next version tag.
hedge_order_gate_reconciliation_timeout_secs = 10
# Durable-read deadline (seconds) for reconciling open hedge order gates.
# Covers loading every Position before each offchain inventory poll; after a
# Position SCHEMA_VERSION bump discards snapshots, idle symbols replay full
# histories (about 11s for the slowest on 2026-09-30), so the former 10s
# deadline aborted the offchain portion of every inventory poll.
hedge_order_gate_reconciliation_timeout_secs = 60

[pricing]
# The pricing plane on Cloud Run for THIS environment. Auth is the VM's
Expand Down
2 changes: 1 addition & 1 deletion config/staging/st0x-hedge.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ inventory_divergence_threshold = 10
# Durable-read deadline (seconds) for reconciling open hedge order gates by
# order ID at startup (st0x.liquidity#1316). Required since that merge; its
# absence crash-looped the staging bot from 10:24 UTC on 2026-09-01.
hedge_order_gate_reconciliation_timeout_secs = 10
hedge_order_gate_reconciliation_timeout_secs = 60

[pricing]
# The pricing plane on Cloud Run for THIS environment. Auth is the VM's
Expand Down
Loading