Feature/rmbarber/census prediction - #9

Open

rmbarber wants to merge 99 commits into

mainfrom

feature/rmbarber/census-prediction

Commits on Jun 25, 2025

add processing procedures for census data to be used in inference
rmbarber
committed
dfd0352
must provide iso3-specific years to intersecting admins
rmbarber
committed
fba528d

Commits on Jun 30, 2025

initial placeholders for using admin inference data in raking
rmbarber
committed
267771d
use colon instead of pipe
rmbarber
committed
9bc3d59
Merge branch 'feature/rmbarber/census-prediction' of https://github.com/ihmeuw/rra-population-model into feature/rmbarber/census-prediction
rmbarber
committed
bb70dcf

Commits on Jul 1, 2025

Commits on Jul 2, 2025

MEX and USA census raking for tool release
rmbarber
committed
7a56020

Commits on Jul 8, 2025

Commits on Jul 12, 2025

add resource scaling and annual chunking to inference data prep; expose arg for raking_factors/raking input data
rmbarber
committed
41bcba9

Commits on Jul 14, 2025

start at 10G/5m and have 20G/10m be the first scale-up
rmbarber
committed
e754b7f

Commits on Aug 7, 2025

set pixels where msft has buildings and ghsl doesnt to be residential
rmbarber
committed
8895e73

Commits on Aug 25, 2025

Commits on Sep 2, 2025

merge gbd2025 and pre-commit check mods from main
rmbarber
committed
3162c28

Commits on Sep 23, 2025

changed pixel agg rasterization methods
Marcon Louie Fikingas
committed
33c409b
Merge pull request #14 from ihmeuw/feature/mfiking/census-prediction/pixel_agg
rmbarber
authored
7db6b02

Commits on Sep 30, 2025

print out years being run up top
rmbarber
committed
413b8de

Commits on Oct 1, 2025

add on tiles missing from model frame
rmbarber
committed
c7e92a4

Commits on Oct 22, 2025

Commits on Nov 7, 2025

streamline measures saved; add new refs for compiled output type
rmbarber
committed
577c70c

Commits on Nov 13, 2025

comment out test run args; add option to rake raw predictions without raking to census
rmbarber
committed
753a913

Commits on Nov 17, 2025

v8 building dataset
rmbarber
committed
7a906c0
adding offset to numerator off occupancy rate, try 0.1
rmbarber
committed
75b5289
still want v7.1 for testing
rmbarber
committed
d03cf2a
left out measures
rmbarber
committed
d57ca97
reorder list
rmbarber
committed
b84aa0f
keep v7.1 for 100m as well
rmbarber
committed
e8dd093
Merge pull request #16 from ihmeuw/feature/rmbarber/microsoft-v8-update
rmbarber
authored
8213bbc
remove handling for 7.1 test versions
rmbarber
committed
aa02db9

Commits on Nov 18, 2025

fix mosaic_tile to pull bordering tiles and not just target tile
rmbarber
committed
4a96807
add subset_bounds for raked_predictions
rmbarber
committed
32048fb
drop another ref to v7.1 d/h models
rmbarber
committed
0c5ab07

Commits on Dec 18, 2025

Commits on Jan 13, 2026

test runs without using offset
rmbarber
committed
b1878af

Commits on Jan 22, 2026

run 2025q3; adapt early access to use anti-meridian
rmbarber
committed
52a5009

Commits on Jan 28, 2026

add manual lon-shift for antimeridian correction
rmbarber
committed
22fc846

Commits on Feb 5, 2026

finish run fixing 0s; process longitude roll correctly for early access data
rmbarber
committed
ff496b3

Commits on Mar 4, 2026

add rwanda to ITU list
rmbarber
committed
0b8c9f0

Commits on Mar 11, 2026

add census raking postprocess
rmbarber
committed
b37f981

Commits on Mar 17, 2026

Commits on Mar 23, 2026

comparison validation; hierarchical admin levels for census raking task based on size/number of child admins
rmbarber
committed
253984c

Commits on Mar 25, 2026

Commits on Mar 26, 2026

update resource scaling (US takes a lot)
rmbarber
committed
deefdc0

Commits on Apr 9, 2026

split census_rake into multiple workflows that are more resource efficient; improve 0 pop use case; swap into raking in place of old inference data
rmbarber
committed
9660b0d

Commits on Apr 10, 2026

separate rf calculation method and include approach to look for closest non-zero point if previous time step is 0
rmbarber
committed
8061b76

Commits on Apr 13, 2026

refactor constraints to (a) look back for prior non-zero, (b) allow gradual redistribution of excess growth, (c) constrain single step and total growth from time of census
rmbarber
committed
c81df79

Commits on May 7, 2026

2025q4; resource updates
rmbarber
committed
ec01df8
add back lost(?) validate methods
rmbarber
committed
01d3f8e

Commits on May 16, 2026

run all time points
rmbarber
committed
cc1bdf0
cache raking data
rmbarber
committed
4430e55

Commits on May 19, 2026

update runner specs for different resolutions and ITU masks (unrelated)
rmbarber
committed
ae7cbbb

Commits on May 29, 2026

distputed admins for ITU; switch raking back to gbd2023
rmbarber
committed
1ccefdc
merge in overture update
rmbarber
committed
3f4be4e
resolve conflict
rmbarber
committed
c5f3309
FHS2023 and new ITU locs
rmbarber
committed
a56e8e7

Commits on Jun 10, 2026

fix incorrect buffer logic and tune resource usage for overture
rmbarber
committed
809160d
Merge pull request #19 from ihmeuw/feature/rmbarber/ip-overture-run
rmbarber
authored
880d265
link log overture
rmbarber
committed
18a7fff

Commits on Jun 22, 2026

remove remnants of 'purpose' in census data and inference; clearly expose census raking downsampling; increase max resources for comparison validation
rmbarber
committed
388d323

Commits on Jun 23, 2026

make copy of series.to_numpy
rmbarber
committed
b93bdf6

Commits on Jul 1, 2026

Commits on Jul 6, 2026

shared skeleton + (b) sjoin border; reprofile workflows
rmbarber
committed
1f506d7

Commits on Jul 7, 2026

Commits on Jul 8, 2026

Commits on Jul 9, 2026

Commits on Jul 10, 2026

Commits on Jul 22, 2026

keep GBD Spain (include Canary Islands); attach N Cyprus to Cyprus (GBD population includes it but shapefile does not); fix UTLA drop bug (4919 -> 4619)
rmbarber
committed
c882c2a

Commits on Jul 28, 2026

Commits on Aug 3, 2026

only check raking factors for area covered by initial raking factors (safely ignore 'unmodeled' locs)
rmbarber
committed
62424fb

Commits on Aug 4, 2026

repair census geometries once at ingestion; drop all downstream validity handling
rmbarber
committed
5a56c1f

Commits on Aug 5, 2026

update resources after reconfiguring geom repair
rmbarber
committed
3b073d4

Commits on Aug 11, 2026

supersample downscaling to improve validation metrics precision
rmbarber
committed
13d7ad1