Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add JASMIN as an additional site to the RTW #3060

Closed
mo-tgeddes opened this issue Feb 28, 2023 · 3 comments · Fixed by #3302
Closed

Add JASMIN as an additional site to the RTW #3060

mo-tgeddes opened this issue Feb 28, 2023 · 3 comments · Fixed by #3302
Assignees
Labels
Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow

Comments

@mo-tgeddes
Copy link
Contributor

Part of #2786.
Add JASMIN to the Recipe Test Workflow.

@mo-tgeddes mo-tgeddes added the Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow label Feb 28, 2023
@mo-tgeddes mo-tgeddes self-assigned this Feb 28, 2023
mo-tgeddes added a commit that referenced this issue Feb 28, 2023
mo-tgeddes added a commit that referenced this issue Mar 8, 2023
mo-tgeddes added a commit that referenced this issue Mar 8, 2023
mo-tgeddes added a commit that referenced this issue Mar 8, 2023
mo-tgeddes added a commit that referenced this issue Mar 13, 2023
mo-tgeddes added a commit that referenced this issue Mar 13, 2023
mo-tgeddes added a commit that referenced this issue Mar 13, 2023
mo-tgeddes added a commit that referenced this issue Mar 13, 2023
mo-tgeddes added a commit that referenced this issue Mar 13, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
mo-tgeddes added a commit that referenced this issue Mar 14, 2023
@mo-tgeddes
Copy link
Contributor Author

Currently partially working with 2/3 compare tasks failing

@ehogan
Copy link
Contributor

ehogan commented Jul 19, 2023

The following assumes that you have an update to date clone of ESMValTool on JASMIN.

To run this workflow on JASMIN (see https://help.jasmin.ac.uk/article/147-cylc-rose-on-jasmin for more details):

  • Add the following line to your ~/.bashrc file to ensure the Cylc and Rose executables can be found:
export PATH=/apps/jasmin/metomi/bin:$PATH
  • SSH to the Rose and Cylc server:
ssh -X cylc
  • Run the RTW on JASMIN:
export CYLC_VERSION=8
cd ESMValTool/esmvaltool/utils/recipe_test_workflow/recipe_test_workflow
cylc vip -O jasmin
  • Check the workflow is running:
cylc tui recipe_test_workflow
  • Check the logs:
more ~/cylc-run/recipe_test_workflow/run<#>/log/job/*/*/01/job.err

@ehogan ehogan linked a pull request Aug 30, 2023 that will close this issue
5 tasks
ehogan added a commit that referenced this issue Aug 30, 2023
ehogan added a commit that referenced this issue Sep 27, 2023
@ehogan ehogan changed the title Add JASMIN as an additional site Add JASMIN as an additional site to the RTW Oct 6, 2023
@ehogan
Copy link
Contributor

ehogan commented Oct 6, 2023

I reported ESMValGroup/ESMValCore#2208 when the process_radiation_budget task failed on JASMIN. The problem should be resolved when we update the RTW to use the latest ESMValTool environment (via Docker) rather than the centrally managed ESMValTool environment on JASMIN.

Alistair and I agreed to add an execution time limit to this branch, then merge the branch (after review, of course!) into the main feature branch (see #2786), accepting that this version of the main feature branch will be "broken", so that Alistair can start work on #3246 (which I have re-opened).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Recipe Test Workflow (RTW) Items relevant to the Recipe Test Workflow
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants