Skip to content

Conversation

@halungge
Copy link
Contributor

@halungge halungge commented Mar 7, 2025

[CI] Adds a minimal pipeline to run the mpi_tests on CSCS-CI.
The pipeline uses its own base image with a minimal MPI installation, and installs icon4py with UV in a test container.

Restrictions of the pipeline setup:

  • tests run only with CPU backends
  • the container based openMPI installation is used, there is no access of the cluster provided MPI infrastructure (same approach as PMAP)
  • DACE orchestration tests in test_parallel_diffusion.py are disabled.

Additional changes

  • All MPI dependent tests are moved to mpi_tests subdirectories for consistent test selection.
  • Some issues in the parallel test are fixed. Other tests are marked xfail.

Magdalena Luz added 30 commits February 11, 2025 16:46
- remove ipeidx_dsl field from MetricStateNonHydro
- read renamed savepoints
- split VelocityAdvectionInit and VelocityAdvectionExit savepoints
remove unnecessary parameters in test_time_step_flags
remove x- from DiffusionExitSavepoint field names
temporarily ignore saturation adjustment tests - need Weisman-Klemp data
@msimberg msimberg force-pushed the parallel_tests_on_ci branch from 98bd813 to fe3818a Compare January 12, 2026 10:32
@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg msimberg mentioned this pull request Jan 14, 2026
@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg msimberg force-pushed the parallel_tests_on_ci branch from a0b7a21 to bf4c865 Compare January 14, 2026 14:31
@msimberg
Copy link
Contributor

cscs-ci run distributed

1 similar comment
@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg msimberg force-pushed the parallel_tests_on_ci branch from 6a755bd to bf4c865 Compare January 15, 2026 09:55
@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg msimberg force-pushed the parallel_tests_on_ci branch from fbee29c to 4ab8ea3 Compare January 15, 2026 16:45
@github-actions
Copy link

Mandatory Tests

Please make sure you run these tests via comment before you merge!

  • cscs-ci run default

Optional Tests

To run benchmarks you can use:

  • cscs-ci run benchmark-bencher

To run tests and benchmarks with the DaCe backend you can use:

  • cscs-ci run dace

To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:

  • cscs-ci run extra

For more detailed information please look at CI in the EXCLAIM universe.

@msimberg
Copy link
Contributor

cscs-ci run distributed

@msimberg msimberg requested a review from DropD January 16, 2026 12:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants