Transport improvements for 2025-W39

[khaeru]

#392 ← previous PR | following PR → #447

• Towards iiasa/message_data#620
  • New input data flow/file stock-cap.csv.
  • Set up calculation of bound_total_capacity_* based on these values.
• Incorporate data changes from Run DIGSY/transport scenarios for 2025-W36 #415 and Transport improvements for 2025-W39 #430.
• iiasa/message_data#623

How to review

Read the diff and note that the CI checks all pass.

PR checklist

• Continuous integration checks all ✅
• Add or expand tests; coverage checks both ✅
• Add, expand, or update documentation.
• Update doc/whatsnew.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 74.7%. Comparing base (5ec6ae5) to head (3eba191).
⚠️ Report is 145 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##            main    #430     +/-   ##
=======================================
- Coverage   75.3%   74.7%   -0.7%     
=======================================
  Files        272     274      +2     
  Lines      22463   22488     +25     
=======================================
- Hits       16932   16807    -125     
- Misses      5531    5681    +150     

Files with missing lines	Coverage Δ
message_ix_models/model/snapshot.py	24.5% <100.0%> (-75.5%)	⬇️
message_ix_models/model/transport/build.py	94.1% <100.0%> (ø)
message_ix_models/model/transport/config.py	98.9% <ø> (ø)
message_ix_models/model/transport/data.py	98.9% <100.0%> (+<0.1%)	⬆️
message_ix_models/model/transport/groups.py	97.0% <100.0%> (ø)
message_ix_models/model/transport/report.py	60.0% <100.0%> (ø)
message_ix_models/model/transport/stock.py	100.0% <100.0%> (ø)
message_ix_models/tests/model/test_emissions.py	100.0% <100.0%> (ø)
...sage_ix_models/tests/model/transport/test_build.py	83.9% <ø> (ø)
message_ix_models/tests/test_tools.py	72.2% <100.0%> (ø)
... and 1 more

... and 8 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[r-aneeque]

[khaeru]

Some tests appear to be flaky due to network issues connecting to worldbank.org, e.g.:

ERROR message_ix_models/tests/tools/test_wb.py::test_get_income_group_codelist - requests.exceptions.ConnectionError: HTTPSConnectionPool(host='datacatalogfiles.worldbank.org', port=443): Max retries exceeded with url: /ddh-published/0037712/DR0090755/CLASS.xlsx (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f7d9b898190>: Failed to establish a new connection: [Errno 101] Network is unreachable'))

These could be resolved by:

• Marking the tests as XFAIL and/or flaky. I think the latter may not help, since when the server is not responding, retries with pauses of a few seconds will not succeed after an initial failure.
• Storing a mirror of the file in a more reliable location, e.g. on Zenodo or in this repo.

For now, I am repeatedly re-running jobs until they pass.