Skip to content

Commit

Permalink
merged with development
Browse files Browse the repository at this point in the history
  • Loading branch information
atteggiani committed Jul 20, 2023
2 parents 8fb99c7 + a50589d commit 3ce2a87
Show file tree
Hide file tree
Showing 2,182 changed files with 1,727 additions and 680 deletions.
2 changes: 1 addition & 1 deletion docs/about/policies.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# <div class="center-icons highlight-bg"> Policies </div>
# <div class="highlight-bg">Policies</div>

- [Procedures and Practices][pandp]: Contains documents outlining how ACCESS-NRI will function. These documents describe what users can expect and justifications for the decisions against criteria that are based on the values of the organisation.

Expand Down
Binary file added docs/assets/community_medlinks.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/community_workinggroups.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/events_1.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/assets/events_2.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/assets/forum_screenshot.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/assets/get_started_example.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/assets/model_evaluation/logo_cosima.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/assets/model_evaluation/logo_esmvaltool.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified docs/assets/model_evaluation/logo_ilamb.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

<!-- {% include "call_contribute.md" %} -->

We are trying to ingest more and more model evaluation and diagnostics recipes in your currated [recipe gallery on this website](../model_evaluation/model_evaluation_recipe_gallery.md) . While this is a continous effort, this site is intented for a list of model evaluation and diagnostics recipes that are not (yet) ingested but may be interesting for the community :
We are trying to ingest more and more model evaluation and diagnostics recipes in your currated [recipe gallery on this website](../../model_evaluation/model_evaluation_recipe_gallery.md). While this is a continous effort, this site is intented for a list of model evaluation and diagnostics recipes that are not (yet) ingested but may be interesting for the community:

<table>
<tr>
Expand Down Expand Up @@ -31,9 +31,9 @@ We are trying to ingest more and more model evaluation and diagnostics recipes i
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -54,8 +54,8 @@ We are trying to ingest more and more model evaluation and diagnostics recipes i
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
</div>
</td>
<td width="64%">
Expand Down Expand Up @@ -83,7 +83,7 @@ We are trying to ingest more and more model evaluation and diagnostics recipes i
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -104,7 +104,7 @@ We are trying to ingest more and more model evaluation and diagnostics recipes i
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon BGC OCEAN (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon BGC OCEAN (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -127,7 +127,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div>
</td>
<td width="64%">
Expand Down Expand Up @@ -171,7 +171,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -191,11 +191,11 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon BGC OCEAN (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon BGC OCEAN (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon OCEAN (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -217,7 +217,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -240,7 +240,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -262,7 +262,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -285,8 +285,8 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon SEA ICE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon LAND SURFACE (Title).png" />
</div>
</td>
<td width="64%">
Expand All @@ -307,7 +307,7 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<!-- <div align='center' width="100%" >
<img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
<img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" />
</div> -->
</td>
<td width="64%">
Expand All @@ -329,15 +329,15 @@ IOMB uses the same code base as the International Land Model Benchmarking (ILAMB
</td>
<td width="10%">
<div align='center' width="100%" >
<!-- <img align="center" width="45%" src="../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" /> -->
<!-- <img align="center" width="45%" src="../../../assets/component-logos/components-with-titles/ACCESS icon ATMOSPHERE (Title).png" /> -->
</div>
</td>
<td width="64%">
<div align='center' width="100%" >
<a href="https://unidata.github.io/MetPy/latest/userguide/index.html">Tutorial</a> |
<a href="https://github.com/Unidata/MetPy">Source Code</a> |
<a href="https://unidata.github.io/MetPy/latest/examples/index.html">Recipes</a>
MetPy is a collection of tools in Python for reading, visualizing, and performing calculations with weather data. MetPy supports Python >= 3.8 and is freely available under a permissive open source license.
<!-- MetPy is a collection of tools in Python for reading, visualizing, and performing calculations with weather data. MetPy supports Python >= 3.8 and is freely available under a permissive open source license. -->
</div>
</td>
</tr>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Community Model Data Catalogs

We are trying to ingest more and more model data catalogs in your currated [catalog on this website](../model_evaluation/model_evaluation_model_catalogs/model_evaluation_search_models.md). While this is a continous effort, this site is intented for a list of additional model data catalogs that are not (yet) ingested but are recommended by us () or may be interesting for the community ():
We are trying to ingest more and more model data catalogs in your currated [catalog on this website](../../model_evaluation/model_evaluation_model_catalogs/model_evaluation_search_models.md). While this is a continous effort, this site is intented for a list of additional model data catalogs that are not (yet) ingested but are recommended by us or may be interesting for the community:

<table class="center">
<tr>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Community Observational Data Catalogs

We are trying to ingest more and more model data catalogs in your currated [catalog on this website](../model_evaluation/model_evaluation_model_catalogs/model_evaluation_search_models.md). While this is a continous effort, this site is intented for a list of additional model data catalogs that are not (yet) ingested but are recommended by us () or may be interesting for the community ():
We are trying to ingest more and more model data catalogs in your currated [catalog on this website](../../model_evaluation/model_evaluation_model_catalogs/model_evaluation_search_models.md). While this is a continous effort, this site is intented for a list of additional model data catalogs that are not (yet) ingested but are recommended by us or may be interesting for the community:

<table class="center">
<tr>
Expand Down
32 changes: 32 additions & 0 deletions docs/community_resources/community_med/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
# Community Model Evaluation and Diagnostics Links

<!-- {% include "call_contribute.md" %} -->

<div class="card-container" style="flex-wrap:nowrap;">
<a href="community_observational_catalogs" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/model_evaluation/model_evaluation_obs_catalog.jpg" alt="Observational Catalogs">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Observational Catalogs</div>
</a>
<a href="community_model_catalogs" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/model_evaluation/model_evaluation_model_catalog.jpg" alt="Model Catalogs">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Model Catalogs</div>
</a>
</div>
<div class="card-container" style="flex-wrap:nowrap;">
<a href="community_data_processing" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/model_evaluation/model_evaluation_formatting.jpg" alt="Data Formatting">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Data Formatting</div>
</a>
<a href="community_med_recipes" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/model_evaluation/model_evaluation_recipe.jpg" alt="Evaluation Recipes">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Evaluation Recipes</div>
</a>
</div>
33 changes: 33 additions & 0 deletions docs/community_resources/computing_on_gadi.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@

# 4) Computing on Gadi

## Gadi Resources
Coupled climate models like ACCESS-CM involve, among other things, calculation of complex mathematical equations that explain the physics of the atmosphere and oceans. Performed at hundreds of millions of points around the Earth, these calculations require vast computing power to complete them in a reasonable amount of time, thus relying on the power of high-performance computing (HPC) like Gadi. The [Gadi supercomputer](https://nci.org.au/our-systems/hpc-systems) can handle more than 10 million billion (10 quadrillion) calculations per second and is connected to 100,000 Terabytes of high-performance research data storage.

An overview of [Gadi resources](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-GadiResources) such as compute, storage and PBS jobs are described below.

Useful NCI commands to check your available compute resources are:

| Command | Purpose |
| ---------------------- | ------------- |
| `logout` or ++ctrl+"D"++ | To exit a session |
| `hostname` | Displays login node details|
| `module list` | Modules currently loaded |
| `module avail` | Available modules |
| `nci_account -P [proj]`| Compute allocation for [proj]|
| `nqstat -P [proj]` | Jobs running/queued in [proj]|
| `lquota` | Storage allocation and usage for all your projects|

### Compute Hours
Compute allocations are granted to projects instead of directly to users and, hence, you need to be a member of a project in order to use its compute allocation. To run jobs on Gadi, you need to have sufficient allocated [compute hours](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-ComputeHours) available, where the [job cost](https://opus.nci.org.au/display/Help/2.+Compute+Grant+and+Job+Debiting) depends on the resources reserved for the job and the amount of walltime it uses.

### Storage
Each user has a project-independent [`$HOME`](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-TheHomeFolder$HOME) directory, which has a storage limit of 10 GiB. All data on `/home` is backed up.

Through project membership, the user gets access to the storage space within the
[project folders](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-ProjectFolderonLustreFilesystems/scratchand/g/data) `/scratch` and `/g/data` filesystems for that particular project.

## PBS Jobs
To run compute tasks such as an ACCESS-CM suite on Gadi, users need to submit them as *jobs* to *queues*. Within a [job submission](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-JobSubmission), you can specify the queue, duration and computational resources needed for your job. When a job submission is accepted, it is assigned a jobID (shown in the return message) that can then be used to monitor the job’s [status](https://opus.nci.org.au/display/Help/0.+Welcome+to+Gadi#id-0.WelcometoGadi-QueueStatus).

On job completion, contents of the job’s standard output/error stream gets copied to a file in the working directory with the respective format: `<jobname>.o<jobid>` and `<jobname>.e<jobid>`. Users should check these two log files before proceeding with post-processing of any output from their corresponding job.
19 changes: 17 additions & 2 deletions docs/community_resources/events/index.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,19 @@
# Workshops and Conferences
# Events

{{ events_content }}
???+ info "We are maintaining a list of upcoming events"
We are maintaining a list of upcoming events for the community on the [ACCESS-NRI website](https://www.access-nri.org.au/community/news-and-events/).

<div class="card-container" style="flex-wrap:nowrap;">
<a href="https://www.access-nri.org.au/community/news-and-events/" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/events_1.jpg" alt="Events List">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Click here to see upcoming events</div>
</a>
<a href="https://www.access-nri.org.au/community/news-and-events/" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/events_2.jpg" alt="Events Get in Touch">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Want to advertise an event? Get in touch here</div>
</a>
</div>
26 changes: 20 additions & 6 deletions docs/community_resources/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,23 @@

In this area of the Hive, we collect content that is not currated by us, but may be helpful for the community. You can [contribute](../contribute/index.md) to this part of the Hive too!

Currently, we provide pointers to the following categories:
- [Working Groups](community_working_groups.md)
- [Glossaries](./glossaries/index.md)
- [Model Evaluation Links](community_model_catalogs)
- [Training](training/)
- [Events](./events/index.md)
<div class="card-container" style="flex-wrap:nowrap;">
<a href="community_working_groups" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/community_workinggroups.jpg" alt="Working Groups">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Working Groups</div>
</a>
<a href="https://www.access-nri.org.au/community/news-and-events/" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/events_2.jpg" alt="Events">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Events</div>
</a>
<a href="community_med_index" class="squared-card default-text-color">
<div class="squared-card-image-container">
<img class="img-cover" src="../../assets/community_medlinks.jpg" alt="Model Evaluation Links">
</div>
<div class="squared-card-text-container highlight-bg bg-color-like-tab bold">Model Evaluation Links</div>
</a>
</div>
Loading

0 comments on commit 3ce2a87

Please sign in to comment.