Skip to content

Retry pytest steps in actions to handle intermittent errors#630

Open
bhazelton wants to merge 2 commits into
mainfrom
retry_actions
Open

Retry pytest steps in actions to handle intermittent errors#630
bhazelton wants to merge 2 commits into
mainfrom
retry_actions

Conversation

@bhazelton

@bhazelton bhazelton commented Jul 15, 2026

Copy link
Copy Markdown
Member

Description

Intermittent errors in GitHub actions have been driving us crazy, so this adds automatic retries of the steps that usually error.

There is an existing action that can be used for this, but it doesn't work with conda because there's no way to use the right shell. So I used that only on the job that uses pypi. In the conda jobs I just manually check if the step passed and re-run it if it didn't.

I also consolidated the warnings test and min_versions test into the top level testing job using matrix includes and simplified the windows os handling the same way.

update: It looks like if the first attempt fails on the weird mpi error so do the retries. Which implies that the mpi error is related to the machine or the installed versions. There are other intermittent errors, so I think this is still helpful, but it doesn't seem to fix all the issues.

Motivation and Context

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Reference simulation update or replacement
  • Documentation change (documentation changes only)
  • Version change
  • Build or continuous integration change

Checklist:

For all pull requests:

Build or continuous integration change checklist:

  • If required or optional dependencies have changed (including version numbers), I have updated the readme to reflect this.
  • If this is a new CI setup, I have added the associated badge to the readme and to references/make_index.py (if appropriate).

@codecov

codecov Bot commented Jul 15, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 100.00%. Comparing base (5213e2b) to head (e4f010e).

Additional details and impacted files
@@            Coverage Diff            @@
##              main      #630   +/-   ##
=========================================
  Coverage   100.00%   100.00%           
=========================================
  Files           11        11           
  Lines         2455      2455           
=========================================
  Hits          2455      2455           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant