Skip to content

Feature/rmbarber/census prediction - #9

Open
rmbarber wants to merge 99 commits into
mainfrom
feature/rmbarber/census-prediction
Open

Feature/rmbarber/census prediction#9
rmbarber wants to merge 99 commits into
mainfrom
feature/rmbarber/census-prediction

Conversation

@rmbarber

@rmbarber rmbarber commented Jul 8, 2025

Copy link
Copy Markdown
Collaborator

Description

Model run used for initial public viz release.

Checklist

  • Tests covering the new functionality have been added
  • Documentation has been updated OR the change is too minor to be documented
  • Changes are listed in the CHANGELOG.md OR changes are insignificant

rmbarber and others added 30 commits June 24, 2025 23:58
…tial

Feature/rmbarber/fill ghsl residential
…pixel_agg

Added different pixel aggregation methods to utils
rmbarber added 30 commits June 30, 2026 17:00
…process; rasterized build_overlay + geometry-free process_census_data; rake as a per-time-point generator; census bbox read (bounds= to load_census_data); filtered load_census_raking_inputs (iso3/census_time_point/task_parent_id)
…s time points with weights > 0; make shapes valid
…BD population includes it but shapefile does not); fix UTLA drop bug (4919 -> 4619)
…ity handling

- preprocess.census_data: sanitize_geometries at write (make_valid + collapse
  GeometryCollections to MultiPolygons + raise if invalid remains); repairs
  change areas by ~1e-12% (verified LVA/ISL/MDV)
- remove downstream repairs: census_rake child repair, rake/raking_factors
  repair_invalid_geometries (make_valid on the 789 invalid task_admin parents
  cost 613s + 2G in every census-splicing rake task), metrics buffer(0)
- raking_factors final: NaN initial factors are legitimate (unmodeled/zero-pop
  supplement locations), only a missing location is a shape mismatch
- add --q1-only to raking_factors/rake for validation products (gbd stage;
  refused for final)
- rake final: two-tier per-task resources -- blocks with raking factors at the
  time point get the full ask, empty blocks get 4G/4m
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant