diff --git a/docs/assets/model_evaluation/Gadi-19-2.jpg b/docs/assets/model_evaluation/Gadi-19-2.jpg new file mode 100644 index 000000000..c587a00ca Binary files /dev/null and b/docs/assets/model_evaluation/Gadi-19-2.jpg differ diff --git a/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png b/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png new file mode 100644 index 000000000..3d4fbe180 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/diurnal_fig1.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-3.png b/docs/assets/model_evaluation/esmvaltool/fig-9-3.png new file mode 100644 index 000000000..314d6ed58 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-3.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-4.png b/docs/assets/model_evaluation/esmvaltool/fig-9-4.png new file mode 100644 index 000000000..e8bc5a87a Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-4.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig-9-8.png b/docs/assets/model_evaluation/esmvaltool/fig-9-8.png new file mode 100644 index 000000000..1f8af11d7 Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig-9-8.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png b/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png new file mode 100644 index 000000000..e05bfbbcd Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/fig4_ipccar5_ch9.png differ diff --git a/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png b/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png new file mode 100644 index 000000000..8ae08da9f Binary files /dev/null and b/docs/assets/model_evaluation/esmvaltool/ltmi1_1.png differ diff --git a/docs/assets/model_evaluation/logo_esmvaltool.png b/docs/assets/model_evaluation/logo_esmvaltool.png new file mode 100644 index 000000000..e87621903 Binary files /dev/null and b/docs/assets/model_evaluation/logo_esmvaltool.png differ diff --git a/docs/assets/model_evaluation/logo_ilamb.png b/docs/assets/model_evaluation/logo_ilamb.png new file mode 100644 index 000000000..cf3a77f9a Binary files /dev/null and b/docs/assets/model_evaluation/logo_ilamb.png differ diff --git a/docs/assets/model_evaluation/logo_pangeo.png b/docs/assets/model_evaluation/logo_pangeo.png new file mode 100644 index 000000000..0f1c636d3 Binary files /dev/null and b/docs/assets/model_evaluation/logo_pangeo.png differ diff --git a/docs/assets/model_evaluation/model_evaluation_conda.png b/docs/assets/model_evaluation/model_evaluation_conda.png new file mode 100644 index 000000000..b2fbb4f44 Binary files /dev/null and b/docs/assets/model_evaluation/model_evaluation_conda.png differ diff --git a/docs/assets/model_evaluation/model_evaluation_variables.png b/docs/assets/model_evaluation/model_evaluation_variables.png new file mode 100644 index 000000000..cbf411a49 Binary files /dev/null and b/docs/assets/model_evaluation/model_evaluation_variables.png differ diff --git a/docs/model_evaluation/index.md b/docs/model_evaluation/index.md index 16daad332..4fbe83b6d 100644 --- a/docs/model_evaluation/index.md +++ b/docs/model_evaluation/index.md @@ -1,46 +1,111 @@ -# Model Evaluation and Diagnostics (MED) +#
Model Evaluation and Diagnostics (MED)
-Model evaluation is about measuring how fit for purpose a particular model is. +Model evaluation is about measuring how fit for purpose a particular model is. If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We provide [tools to process such data](./model_evaluation_data_processing.md) into a comparable format and a [gallery of recipes to evaluate](https://medportal.herokuapp.com/models/published) the formatted data. -If you are new to model evaluation and diagnostics, we recommend you read our [Getting Started with MED page](./model_evaluation_getting_started/index.md). +## Getting Started +
+ +
+ Computing Access +
+
Computing Access
+ + +
+ MED Conda Environment +
+
MED Conda Environment
+ + +
+ Model Variables +
+
Model Variables
+ +
-Here, we provide catalogs and pointers to [observational data](./model_evaluation_observational_catalogs.md) as well as [model data](./model_evaluation_model_catalogs/index.md) that can be used for evaluation. We provide [tools to process such data](./model_evaluation_data_processing.md) into a comparable format and a [gallery of recipes to evaluate](https://medportal.herokuapp.com/models/published) the formatted data. +## Data Catalogs +
+ +
+ A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty Images +
+
Observational Data Catalog
+ + +
+ MED Conda Environment +
+
Model Data Catalog
+ +
- -## TBD: FRAMEWORKS AND RECIPES +## Evaluation Tools + +### Frameworks on Gadi + +
+ +
+ ILAMB +
+
ILAMB
+ + +
+ ESMValTool +
+
ESMValTool
+ + +
+ Pangeo/COSIMA +
+
Pangeo/COSIMA
+ +
+ +### What is to come: Diagnostics, Recipe Gallery and more + +{% include "call_contribute.md" %} + +
+ +
+ Computing Access +
+
Computing Access
+ + +
+ A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/ +
+
Data Format Processing
+ + +
+ A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipes +
+
Evaluation Recipe Gallery
+ +
+ + + ## TBD: CMORisation TBD: Raw data vs. curated data: CMORized vs. not! What does CMORized actually mean (look at ESMValTool documentation)? - TBD: Add APP4 to navigation (replace **Model Format Processing**?) TBD: Tools to check if data is CMOR-compliant (raise issue) TBD: Discuss with Dougie: How can we identify what is CMORized and what is not? - - - - - - - - - -
-
A picture of a seismograph recording seismic waves during an earthquake visualises the link to our Observational Data Catalog. Image credit: Wf Sihardian—EyeEm/Getty ImagesObservational Data Catalog -
 -
Model Data Catalog -
 -
A picture visualising the conversion of data in text columns into a useful python xarray data format. Image credit: https://support.solarwinds.com and https://i.stack.imgur.com/Data Format Processing -
 -
A code snippet from the COSIMA documented recipes. Image credit: https://github.com/COSIMA/cosima-recipesEvaluation Recipe Gallery -
- -Our vision: PLACEHOLDER FOR OUTCOME OF STAFF RETREAT \ No newline at end of file +--> \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md b/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md index e8776b523..134c4f29b 100644 --- a/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md +++ b/docs/model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md @@ -11,9 +11,17 @@ Note: You do not automatically have access to all of Gadi's storage at `/g/data/ To avoid running multiple (different) versions of code on Gadi, we provide you with a `conda` environment called `access-med` that we actually curate for you (version 0.1 is from June 2023). In order to change to this environment, please execute the following commands after loggin onto Gadi (and as part of your PBS scripts): + + module use /g/data/xp65/public/modules + module load conda/access-med + Loading conda/access-med-0.1 + Loading requirement: singularity + esmvaltool recipes list + + ``` $ module use /g/data/xp65/public/modules -$ module load conda/access-med-0.1 +$ module load conda/access-med ``` If you are planning to run your code through JupyterLab on [NCI's ARE](https://are.nci.org.au), you need to use `/g/data/xp65/public/modules` as **Module directories** and `conda/are` as **Modules** when launching a JupyterLab session. diff --git a/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md b/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md index dbd14f751..32d41efef 100644 --- a/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md +++ b/docs/model_evaluation/model_evaluation_getting_started/model_variables/index.md @@ -4,5 +4,4 @@ Speaking a common language and using the same variables is key for a united clim Here, we are collating lists of different widely used variable formats: 1) CMIP6 : Coupled Model Intercomparison Project (CMIP) Version 6 -2) ERA5 : fifth generation ECMWF atmospheric reanalysis of the global climate -3) UM : Unified Model \ No newline at end of file +2) ERA5 : fifth generation ECMWF atmospheric reanalysis of the global climate \ No newline at end of file diff --git a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md index b6eb081a2..90e387305 100644 --- a/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md +++ b/docs/model_evaluation/model_evaluation_on_gadi/model_evaluation_on_gadi_esmvaltool.md @@ -2,4 +2,154 @@ {% include "call_contribute.md" %} -Explain what the Tiers mean: Tier3 not to be distributed / license issue, Tier2: some restrictions, but can be redistributed while citing papers etc., Tier1: open for everyone \ No newline at end of file +ACCESS-NRI is currating the latest version of [ESMValTool](). + +Below, we give a quick overview on how to run and configure `esmvaltool` on Gadi. + +## Running `esmvaltool` on Gadi + +#### What recipes are available? +``` + esmvaltool recipes list +``` + +#### Details of a recipe +``` +esmvaltool recipes show recipe_name.yml +``` + +#### Running an recipe yourself + +``` +esmvaltool run examples/recipe_python.yml --search_esgf=when_missing +``` + +## Working `esmvaltool` recipes on Gadi + + + +Below you can find the recipes from `esmvaltool` that we are providing to run on Gadi. The original recipes are + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+ recipe_flato13ipcc.yml + recipe_perfmetrics_CMIP5.yml + recipe_ecs_scatter.yml
+ recipe_flato13ipcc.yml + recipe_flato13ipcc.yml + recipe_diurnal_index.yml
+ recipe_crem.yml + recipe_collins13ipcc.yml + recipe_autoassess_stratosphere.yml
+ recipe_lauer13jclim.yml + recipe_zmnam.yml + recipe_russell18jgr.yml
+ recipe_sea_surface_salinity.yml + recipe_schlund20esd.yml + recipe_runoff_et.yml
+ recipe_perfmetrics_CMIP5.yml + recipe_spei.yml + recipe_runoff_et.yml
+ recipe_hyint.yml + recipe_cox18_nature.yml + recipe_extreme_events.yml
+ recipe_smpi.yml + recipe_landcover.yml + recipe_miles_block.yml
+ recipe_esacci_oc.yml + recipe_ocean_ice_extent.yml + recipe_ocean_amoc.yml
\ No newline at end of file diff --git a/mkdocs.yml b/mkdocs.yml index 4a8254c95..fc85db9c4 100644 --- a/mkdocs.yml +++ b/mkdocs.yml @@ -122,7 +122,7 @@ nav: # - Getting Started: # - models/running-a-model/getting_started/index.md # - Access to Gadi@NCI: models/running-a-model/getting_started/access_to_gadi_at_nci.md - - Computing Access (Gadi@NCI): models/run-a-model/getting_started/access_to_gadi_at_nci.md + - Gadi Computing Access at NCI: models/run-a-model/getting_started/access_to_gadi_at_nci.md - Run ACCESS-ESM: models/run-a-model/run-access-esm.md - Run ACCESS-CM: models/run-a-model/run-access-cm.md - Run ACCESS-AM: models/run-a-model/run-access-am.md @@ -132,13 +132,12 @@ nav: - model_evaluation/index.md - Getting Started: - model_evaluation/model_evaluation_getting_started/index.md - - Computing Access (Gadi@NCI): model_evaluation/model_evaluation_getting_started/access_to_gadi_at_nci.md + - Gadi Computing Access at NCI: model_evaluation/model_evaluation_getting_started/access_to_gadi_at_nci.md - Model Evaluation on Gadi: model_evaluation/model_evaluation_getting_started/model_evaluation_getting_started.md - Model Variables: - model_evaluation/model_evaluation_getting_started/model_variables/index.md - CMIP6: model_evaluation/model_evaluation_getting_started/model_variables/variables_cmip6.md - ERA5: model_evaluation/model_evaluation_getting_started/model_variables/variables_era5.md - - UM: model_evaluation/model_evaluation_getting_started/model_variables/variables_um.md - Data Catalogs: - Observational Data: model_evaluation/model_evaluation_observational_catalogs.md - Model Data: