Various fixes for CORDEX model data#3135
Conversation
…ion and streamline coordinate handling
This update introduces a new section in the preprocessor documentation detailing how to regrid to standard CORDEX domains using the `target_grid` parameter. An example configuration for the `EUR-11` domain is provided, clarifying the use of domain names recognized by the `cordex` package.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #3135 +/- ##
==========================================
+ Coverage 96.25% 96.26% +0.01%
==========================================
Files 274 280 +6
Lines 16189 16258 +69
==========================================
+ Hits 15582 15651 +69
Misses 607 607 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
…grid-cordex-domain
…mvalcore into more-cordex-fixes
|
I got some of this issues from the recipe yesterday. I'm going to test this PR. |
This reverts commit 082a121.
|
Thanks! I'll stop working on this branch then and start a new branch for further fixes. |
|
You can keep making changes. I thought you finished when you put me in the reviewer. Just ping me again when you finish all changes. |
|
It's finished for the perfmetrics recipe, but then I tried adding another recipe plotting the models without first regridding and ran into #3145. |
|
I tried the recipe and it never finishes not progressing from there!! There is a problem with |
|
The recipe doesn't finish along with |
|
What settings are you using for Dask? The current recipe_perfmetrics_CORDEX-CMIP5.yml runs in about 25 minutes on Levante with these settings: $ cat ~/.config/esmvaltool/dask.yml
max_parallel_tasks: 10
dask:
use: threaded
profiles:
threaded:
num_workers: 8and produces this figure: ESMValGroup/ESMValTool#4199 (comment) |
|
I was able to run the recipe successfully. |
Description
aliasfacet and group the datasets in theensemble_statisticspreprocessor function so they work for CORDEX dataensemble_statisticspreprocessor function withrcm_version,driver, andgrid. Related to Ensemble creation in currentensemble_statisticspreprocessor is not optimal #2044.long_nameand standard variable names for coordinates for all variables from modelHadREM3-GA7-05because these are non standarduse_standard_grid: trueby default for modelsCOSMO-crCLIM-v1-1,RACMO22E, andRCA4because these models are missing bounds on the lat/lon coordinates. This could alternatively be solved by computing the lat/lon bounds from the rotated lat/lon bounds.grid_latitudeandgrid_longitudefor modelWRF381Pwith driverMPI-M-MPI-ESM-LRDataset problem: rlut_EUR-11_MPI-M-MPI-ESM-LR_historical_r1i1p1_IPSL-WRF381P_v1_day_19510101-20051231.nc has invalid projection coordinates #3145.heightcoordinate from variablesnwof modelCOSMO-crCLIM-v1-1as it does not make sense for this variablesicfrom modelHadREM3-GA7-05, the NetCDF attribute says the units are in%, but from the values it seems more likely that the units are1.cliviandprwfor modelCCLM4-8-17with driverMOHC-HadGEM2-ES. Based on comparison with the other drivers, these units are likely off by a factor of 1000, i.e. the units in the NetCDF attribute arekg m-2, but based on the values they are likelyMg m-2. Dataset problem: units of v20150320/clivi_EUR-11_MOHC-HadGEM2-ES_historical_r1i1p1_CLMcom-CCLM4-8-17_v1_day_20010101-20051230.nc are off #3147Testing
These changes can be tested with
recipe_perfmetrics_CORDEX-CMIP5.ymlfrom ESMValGroup/ESMValTool#4199. It should also be possible to test the changes to theensemble_statisticspreprocessor function by using it in that recipe.Before you get started
Checklist
It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.
To help with the number pull requests: