Run MPI tests in CI with CPU backends#692

Draft

halungge wants to merge 167 commits intomainfrom

parallel_tests_on_ci

Commits on Feb 11, 2025

adapting to restructured dataset
Magdalena Luz
committed
pre-commit
Magdalena Luz
committed

Commits on Feb 12, 2025

Merge branch 'main' into serialization_data_update
Magdalena Luz
committed
rename solve non hydro savpoints
Magdalena Luz
committed
fix loading for solve_nonhydro savepoints
Magdalena Luz
committed

Commits on Feb 13, 2025

split substep fixture into substep_init and substep_exit, add leastsquares field to interpolation savepoint
Magdalena Luz
committed
fixing nonhydro tests
Magdalena Luz
committed
remove dummy test
Magdalena Luz
committed
fix wrong fields names in IconSolveNonHydroExit
Magdalena Luz
committed

Commits on Feb 14, 2025

first changes on advection tests
Magdalena Luz
committed
remove jstep fixtures -> use substep_exit/init instead
Magdalena Luz
committed
adapt advection datatest
Magdalena Luz
committed
pre-commit
Magdalena Luz
committed
remove dummy test
Magdalena Luz
committed
remove advection uris
Magdalena Luz
committed
trade jstep fixture for substep in test_timeloop.py
Magdalena Luz
committed
remove unused fixtures
Magdalena Luz
committed

Commits on Feb 18, 2025

rename fixture for IconNonHydroFinalSavepoint
Magdalena Luz
committed
rename Level TypeAlias
Magdalena Luz
committed
Merge branch 'main' into serialization_data_update
Magdalena Luz
committed
pre-commit
Magdalena Luz
committed

Commits on Feb 19, 2025

fix data loading
Magdalena Luz
committed
add vn_only fixture to test_timeloop.py
Magdalena Luz
committed

Commits on Feb 25, 2025

add diagnostics init savepoint
Magdalena Luz
committed
merge main
Magdalena Luz
committed
remove unused field
Magdalena Luz
committed

Commits on Feb 26, 2025

adapt jabw and gauss3d tests
Magdalena Luz
committed

Commits on Feb 27, 2025

adapt driver tests
Magdalena Luz
committed
change mount path for serialized data - path with new data
Magdalena Luz
committed
adapt tools (1) substep fixtures instad of jstep
Magdalena Luz
committed
fix naming, fixtures and access patterns
Magdalena Luz
committed
fix fixtures import
Magdalena Luz
committed
add directory listing for debugging
Magdalena Luz
committed
add debug printout for loaded test path
Magdalena Luz
committed
add TODO for microphysics savepoints, add warning with datapath
Magdalena Luz
committed
fix wrapper tests
Magdalena Luz
committed
remove debugging output
Magdalena Luz
committed
xfail the start_index test in grid_manager for edge/END. icon data has changed (log output of R02B04 run)
Magdalena Luz
committed
xfail the start_index test in grid_manager for edge/END. icon data has changed (log output of R02B04 run)
Magdalena Luz
committed

Commits on Feb 28, 2025

add module level skips to parallel tests.
Magdalena Luz
committed
fix: trade jstep for substep in driver initialization_utils.py
Magdalena Luz
committed
add bool cast (following review)
Magdalena Luz
committed
update data URI
Magdalena Luz
committed
remove comments that should not have been commmitted
Magdalena Luz
committed

Commits on Mar 4, 2025

merge main
Magdalena Luz
committed
WIP
Magdalena Luz
committed
remove skips from parallel tests
Magdalena Luz
committed

Commits on Mar 6, 2025

move mpi dependent decomposition tests to mpi_test subfolder for consistent test selection
Magdalena Luz
committed
noxfile add selection for mpi tests
Magdalena Luz
committed
pre-commit
Magdalena Luz
committed
Merge branch 'main' into parallel_tests_on_ci
Magdalena Luz
committed

Commits on Mar 7, 2025

WIP add distributed.yml
Magdalena Luz
committed
remove skips in parallel tests
Magdalena Luz
committed
run mpirun inside nox session (local usage!)
Magdalena Luz
committed
add env variables for mpi4py build in distributed.yml
Magdalena Luz
committed

Commits on Mar 11, 2025

use scikit build core for mpi4py build
Magdalena Luz
committed
debug: log some environment variables
Magdalena Luz
committed
add libnuma-dev to test container
Magdalena Luz
committed
set SLURM_NTASKS=1
Magdalena Luz
committed
try SLURM_JOB_NUM_NODES: 4
Magdalena Luz
committed

Commits on Mar 12, 2025

add build stage in base.yml
Magdalena Luz
committed
fix stages
Magdalena Luz
committed
try to fix pwd
Magdalena Luz
committed
fix wrong extends key
Magdalena Luz
committed
artifacts path
Magdalena Luz
committed
artifacts path
Magdalena Luz
committed
artifacts path
Magdalena Luz
committed

Commits on Mar 13, 2025

remove artifacts
Magdalena Luz
committed
try out docker build
Magdalena Luz
committed
avoid building single node container
Magdalena Luz
committed
fix Docker file
Magdalena Luz
committed
fix Docker file
Magdalena Luz
committed
fix VENV name (hopefully)
Magdalena Luz
committed
add -k flag in test run, remove no-dev for build (we need test group)
Magdalena Luz
committed

Commits on Mar 17, 2025

fix fixture loading for parallel procs, add printout for logging (TBR)
Magdalena Luz
committed
set CC and MPICC vars
Magdalena Luz
committed
debug output in uv sync
Magdalena Luz
committed
debug output in uv sync
Magdalena Luz
committed
fix component path
Magdalena Luz
committed
use base image without nvidia tools
Magdalena Luz
committed
remove include base.yml
Magdalena Luz
committed
remove include base.yml
Magdalena Luz
committed
move "model" from docker tag
Magdalena Luz
committed

Commits on Mar 18, 2025

update main
Magdalena Luz
committed

Commits on Mar 19, 2025

clean up configurations
Magdalena Luz
committed
split from base.yml
Magdalena Luz
committed
update base image
Magdalena Luz
committed
update base image
Magdalena Luz
committed

Commits on Mar 20, 2025

add back libreadline
Magdalena Luz
committed
check glibc version
Magdalena Luz
committed

Commits on May 6, 2025

merge main
Magdalena Luz
committed
remove old yaml file
Magdalena Luz
committed

Commits on May 7, 2025

fix parallel solve nonhydro tests
Magdalena Luz
committed
add data uris for APE
Magdalena Luz
committed
remove debugging output in test stage
Magdalena Luz
committed
add cd /icon4py+-
Magdalena Luz
committed

Commits on May 8, 2025

move python env activation to before_script
Magdalena Luz
committed
remove workdir from docker file
Magdalena Luz
committed
use docker file workdir
Magdalena Luz
committed
fix work directory
Magdalena Luz
committed
clean base docker image (uv installation)
Magdalena Luz
committed
debug cd error (WIP1)
Magdalena Luz
committed
debug cd error (WIP1)
Magdalena Luz
committed
debug cd error (WIP1)
Magdalena Luz
committed
debug cd error (WIP1)
Magdalena Luz
committed
clean up debug output, use openmpi
Magdalena Luz
committed
SLURM_NTASKS: 4
Magdalena Luz
committed
use --no-cache for uv
Magdalena Luz
committed
run pytest directly
Magdalena Luz
committed

Commits on May 9, 2025

try USE_MPI:yes with SLUM_NTASKS:1
Magdalena Luz
committed
add dace to distributed_venv.Dockerfile
Magdalena Luz
committed
reset NTASKS (for openmpi), limit pytest to n=1 procs
Magdalena Luz
committed
use --host option to mpirun
Magdalena Luz
committed
use --host option to mpirun (2)
Magdalena Luz
committed
use slurm only
Magdalena Luz
committed
try --host config again
Magdalena Luz
committed
add dace backend
Magdalena Luz
committed
Merge branch 'main' into parallel_tests_on_ci
Magdalena Luz
committed
disable orchestration test in test_parallel_diffusion.py
Magdalena Luz
committed
revert unused changes in testing infrastructure
Magdalena Luz
committed
clean out base_mpi.Dockerfile
Magdalena Luz
committed
update ubuntu base image, set to fixed uv version
Magdalena Luz
committed
try setting use_mpi without slurm tasks
Magdalena Luz
committed
revert last try
Magdalena Luz
committed

Commits on May 13, 2025

set SLURM_TASKS with env for
Magdalena Luz
committed

Commits on May 14, 2025

formatting changes
Magdalena Luz
committed
reset SLURM_NTASKS from the script command
Magdalena Luz
committed
try host parameter
Magdalena Luz
committed

Commits on May 15, 2025

add comment for INVALID_INDEX handling in compute_cells_aw_verts
Magdalena Luz
committed

Commits on May 28, 2025

Merge branch 'main' into parallel_tests_on_ci
Magdalena Luz
committed
fix comparision of rho_ic (wrong field)
Magdalena Luz
committed
explicitly set USE_MPI with NTASKS=1
Magdalena Luz
committed

Commits on Jul 3, 2025

Merge branch 'main' into parallel_tests_on_ci
Magdalena Luz
committed
explicity set use_mpi to false and and SLURM_CPU_BIND
Magdalena Luz
committed

Commits on Jul 4, 2025

reset SLURM_NTASK in before script
Magdalena Luz
committed
fix syntax error
Magdalena Luz
committed
fix data path
Magdalena Luz
committed
run single node tests
Magdalena Luz
committed

Commits on Dec 3, 2025

Merge branch 'main' into parallel_tests_on_ci
Magdalena Luz
committed
delete duplicate fixture, fix simple tests
Magdalena Luz
committed
delete duplicate fixture, fix simple tests
Magdalena Luz
committed

Commits on Dec 4, 2025

delete change in base.Dockerfile
Magdalena Luz
committed

Commits on Jan 12, 2026

Commits on Jan 15, 2026