Skip to content

Commit

Permalink
Merge pull request #521 from ACCESS-Hive/dev/sven/ct11
Browse files Browse the repository at this point in the history
exchange ILAMB/IOMB project to ct11 and add screenshot
  • Loading branch information
svenbuder authored Aug 18, 2023
2 parents a1e9f17 + beb5977 commit fb81b3c
Show file tree
Hide file tree
Showing 7 changed files with 17 additions and 17 deletions.
Binary file modified docs/assets/model_evaluation/logo_nci_data_catalogs.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/model_evaluation/obs_data_ct11.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions docs/community_resources/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,13 +11,13 @@ In this area of the Hive, we collect content that is not currated by us, but may
</div>
<div class="vertical-card-text-container bold">Working Groups</div>
</a>
<a href="https://www.access-nri.org.au/community/news-and-events/" class="vertical-card aspect-ratio1to1">
<a href="https://www.access-nri.org.au/community/events/" class="vertical-card aspect-ratio1to1" target="_blank">
<div class="vertical-card-image-container">
<img class="img-cover" src="../assets/events_2.jpg" alt="Events">
</div>
<div class="vertical-card-text-container bold">Events</div>
</a>
<a href="community_med_index" class="vertical-card aspect-ratio1to1">
<a href="community_med" class="vertical-card aspect-ratio1to1">
<div class="vertical-card-image-container">
<img class="img-cover" src="../assets/community_medlinks.jpg" alt="Model Evaluation Links">
</div>
Expand Down
2 changes: 1 addition & 1 deletion docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ hide:
<div class="vertical-card-image-container">
<img class="img-cover" src="assets/community_medlinks.jpg" alt="Model Evaluation">
</div>
<div class="vertical-card-text-container highlight-bg bg-color-like-tab bold">Model Evaluation</div>
<div class="vertical-card-text-container highlight-bg bg-color-like-tab bold">Data and Model Evaluation</div>
</a>
<a href="community_resources" class="vertical-card aspect-ratio1to1">
<div class="vertical-card-image-container">
Expand Down
16 changes: 8 additions & 8 deletions docs/model_evaluation/model_evaluation_observational_catalogs.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Observational Data Catalogue

We are working in cooperation with NCI to currate observational data collections for you that are being hosted by NCI. ACCESS-NRI and NCI are actively currating the data collections and we are working on including new data collections.
ACCESS-NRI and NCI as the data host are currating data collections on the NCI storage and we are working on including new, currated data collections.

You can search the available data collections on the NCI Data Collections website:

Expand All @@ -9,14 +9,14 @@ You can search the available data collections on the NCI Data Collections websit
<div class="vertical-card-image-container">
<img src="../../assets/model_evaluation/logo_nci_data_catalogs.png" alt="NCI Data Collections" class="img-cover"></img>
</div>
<div class="vertical-card-text-container bold ">NCI Data Collections</div>
<div class="vertical-card-text-container bold ">Search for data here</div>
</a>
<!-- <a href="https://esgf.nci.org.au/projects/esgf-nci/" target="_blank" class="vertical-card aspect-ratio1to1">
<div class="vertical-card-image">
<img src="../../assets/model_evaluation/logo_nci_data_esgf.png" alt="ESGF Data Collection at NCI"></img>
</div>
<div class="vertical-card-text bold">ESGF Data at NCI</div>
</a> -->
</div>

Below you can see a screenshot of an example catalogue (NCI project `ct11`) of ACCESS-NRI Replicated Datasets for Climate Model Evaluation (you can find this particular entry by searching `ACCESS-NRI`):

<div style="text-align: center;">
<a href="https://geonetwork.nci.org.au/geonetwork/srv/eng/catalog.search#/metadata/f7199_2480_5432_9703" target="_blank"><img src="../../assets/model_evaluation/obs_data_ct11.png" alt="Edited Screenshot of NCI Data Catalogue for ACCESS-NRI replicated data" width="75%"/></a>
</div>

<!-- In particular, we want to highlight the Coupled Model Intercomparison Project Phases 6 and 5 that are hosted by NCI as a sponsor of the [Earth System Grid Federation (ESGF)](https://esgf.nci.org.au/projects/esgf-nci/). The ESGF are federated data centres across the globe that enable access to the largest archive of climate data world-wide. This portal allows you to find, select and download data files from the federation. -->
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ Our plan is to routinely run benchmarks and comparisons of the ACCESS models CMI

NCI Projects requires to run the set of ESMValTool recipes:

- xp65, kj13, fs38, oi10, rr3, al33, rt52, zz93, qv56
- xp65, ct11, fs38, oi10, rr3, al33, rt52, zz93, qv56


#### Load the `access-med` conda environment
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -56,12 +56,12 @@ You can of course change the path of the directory, but will need to take this i

### 1.2 ILAMB_ROOT/DATA

An extensive colletion of DATA is provided in the `kj13` project. You need to have [joined the project on NCI](https://my.nci.org.au/mancini/project-search) to get access to this data.
An extensive colletion of DATA is provided in the `ct11` project. You need to have [joined the project on NCI](https://my.nci.org.au/mancini/project-search) to get access to this data.

To create a symbolic link to this data, use the bash command
```
ln -s /g/data/kj13/datasets/ilamb/DATA/* $ILAMB_ROOT/DATA/
ln -s /g/data/kj13/datasets/iomb/DATA/* $ILAMB_ROOT/DATA/
ln -s /g/data/ct11/access-nri/replicas/ILAMB/* $ILAMB_ROOT/DATA/
ln -s /g/data/ct11/access-nri/replicas/IOMB/* $ILAMB_ROOT/DATA/
```
Note that the directory `WOA2018` is an overlapping catalogue (you can ignore the warning that a link already exists).
For more information on the data sets, please visit the the `ilamb` [dataset website](https://www.ilamb.org/datasets.html).
Expand Down Expand Up @@ -221,7 +221,7 @@ The following default PBS file, let's call it `ilamb_test.sh` can help you to se
#PBS -l mem=32GB
#PBS -l jobfs=10GB
#PBS -l walltime=00:10:00
#PBS -l storage=gdata/xp65+gdata/kj13+gdata/fs38
#PBS -l storage=gdata/xp65+gdata/ct11+gdata/fs38
#PBS -l wd
module use /g/data/xp65/public/modules
Expand All @@ -233,7 +233,7 @@ export CARTOPY_DATA_DIR=/g/data/xp65/public/apps/cartopy-data
ilamb-run --config cmip.cfg --model_setup $PWD/modelroute.txt --regions global
```

If you are not familiar with PBS jobs on NCI, you could find the guide [here](https://opus.nci.org.au/display/Help/4.+PBS+Jobs). In brief: this PBS script (which you can submit via the bash command `qsub ilamb_test.sh`), will submit a job to Gadi with the job name (`#PBS -N`) *default_ilamb* under project (`#PBS -P`) `tm70` with a normal queue (`#PBS -q normalbw`), for 1 CPU (`#PBS -l ncpus=1`) with 32 GB RAM (`#PBS -l mem=32GB`), with an walltime of 10 hours (`#PBS -l walltime=00:10:00`) and access to 10 GB local disk space (`#PBS -l jobfs=10GB`) as well as data storage access to projects `xp65`, `kj13`, and `fs38` (again, note that you have to be [member of both projects on NCI](https://my.nci.org.au/mancini/project-search). Upon starting the job, it will change into to the working directory that you started the job from (`#PBS -l wd`) and load the access-med conda environment. Finally, it will export the $ILAMB_ROOT as well as $ARTOPY_DATA_DIR paths and start an `ilamb-run`.
If you are not familiar with PBS jobs on NCI, you could find the guide [here](https://opus.nci.org.au/display/Help/4.+PBS+Jobs). In brief: this PBS script (which you can submit via the bash command `qsub ilamb_test.sh`), will submit a job to Gadi with the job name (`#PBS -N`) *default_ilamb* under project (`#PBS -P`) `tm70` with a normal queue (`#PBS -q normalbw`), for 1 CPU (`#PBS -l ncpus=1`) with 32 GB RAM (`#PBS -l mem=32GB`), with an walltime of 10 hours (`#PBS -l walltime=00:10:00`) and access to 10 GB local disk space (`#PBS -l jobfs=10GB`) as well as data storage access to projects `xp65`, `ct11`, and `fs38` (again, note that you have to be [member of both projects on NCI](https://my.nci.org.au/mancini/project-search). Upon starting the job, it will change into to the working directory that you started the job from (`#PBS -l wd`) and load the access-med conda environment. Finally, it will export the $ILAMB_ROOT as well as $ARTOPY_DATA_DIR paths and start an `ilamb-run`.

In our example, we actually run the `cmip.cfg` file from the `ilamb` [config file github repository](https://github.com/rubisco-sfa/ILAMB/blob/master/src/ILAMB/data/) for files spec

Expand Down

0 comments on commit fb81b3c

Please sign in to comment.