Enable gauss3d experiment for distributed tests by msimberg · Pull Request #1013 · C2SM/icon4py

msimberg · 2026-01-28T14:03:21Z

Requires #1004 and the gauss3d test data.

Enables the gauss3d experiment as test input for the distributed tests.

xfails a few remaining gauss3d tests that need domain_length/height to do the computation, which is not available in the serialized data.

Also does a small refactoring to the Grid definitions to have the torus grid domain length/height avaiable for tests that don't read grid files. I've also moved the number of cells/vertices/edges to the GlobalGridParams in the Grid definition.

…ests

msimberg · 2026-02-06T16:29:57Z

cscs-ci run distributed

msimberg · 2026-02-06T16:45:42Z

cscs-ci run default

…ests

msimberg · 2026-02-09T09:03:35Z

cscs-ci run default

msimberg · 2026-02-09T09:33:31Z

@jcanton @edopao FYI I tried to enable testdata download on this PR to get the latest torus data, but CI reports permission denied on the testdata directory: https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/5125340235196978/2255149825504669/-/jobs/13036430153#L1904. Should the icontest user be given permissions to write to that directory or do we stick to manually updating the data?

edopao · 2026-02-09T10:06:01Z

@jcanton @edopao FYI I tried to enable testdata download on this PR to get the latest torus data, but CI reports permission denied on the testdata directory: https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/5125340235196978/2255149825504669/-/jobs/13036430153#L1904. Should the icontest user be given permissions to write to that directory or do we stick to manually updating the data?

I have added write permission to the user group. I will retrigger the CI now.

edopao · 2026-02-09T10:06:18Z

cscs-ci run default

msimberg · 2026-02-09T11:18:12Z

cscs-ci run distributed

msimberg · 2026-02-09T12:30:43Z

@jcanton @edopao FYI I tried to enable testdata download on this PR to get the latest torus data, but CI reports permission denied on the testdata directory: https://gitlab.com/cscs-ci/ci-testing/webhook-ci/mirrors/5125340235196978/2255149825504669/-/jobs/13036430153#L1904. Should the icontest user be given permissions to write to that directory or do we stick to manually updating the data?

I have added write permission to the user group. I will retrigger the CI now.

Thanks @edopao! Tests work now (failing because of the tests themselves, but the download is successful).

…ests

msimberg · 2026-02-12T13:39:48Z

@jcanton @nfarabullini I think this is mostly ok (pending CI coming back online...), but I've marked the tests that require domain_length/height for the torus grid as xfail for now. I'd like to attempt a slightly bigger refactoring of GlobalGridParams/GridShape so we could get the information from there (from model/testing/definitions.py, i.e. read from grid file even when serialized data). Alternatively, I may just try to add the information to the serialized data.

In any case, if you don't object I'd prefer to have the current state merged as is (modulo review comments) as it enables the torus grid for most parallel tests.

msimberg · 2026-02-12T13:40:02Z

cscs-ci run default

msimberg · 2026-02-12T13:40:08Z

cscs-ci run distributed

msimberg · 2026-02-25T20:35:59Z

cscs-ci run default

msimberg · 2026-02-25T20:36:05Z

cscs-ci run distributed

msimberg · 2026-02-25T21:32:20Z

cscs-ci run default

…ests

msimberg · 2026-02-26T11:52:45Z

cscs-ci run default

msimberg · 2026-02-26T11:52:51Z

cscs-ci run distributed

…y.py Co-authored-by: Jacopo Canton <jacopo.canton@gmail.com>

…o gauss3d-distributed-tests

github-actions · 2026-02-26T13:33:49Z

Mandatory Tests

Please make sure you run these tests via comment before you merge!

cscs-ci run default
cscs-ci run distributed

Optional Tests

To run benchmarks you can use:

cscs-ci run benchmark-bencher

To run tests and benchmarks with the DaCe backend you can use:

cscs-ci run dace

To run test levels ignored by the default test suite (mostly simple datatest for static fields computations) you can use:

cscs-ci run extra

For more detailed information please look at CI in the EXCLAIM universe.

jcanton

good now, nice to finally have all these tests for torus too!

msimberg · 2026-02-26T13:40:16Z

cscs-ci run default

msimberg · 2026-02-26T13:40:21Z

cscs-ci run distributed

* main: Reject namelist parameters not supported (#1079) Update to gt4py v1.1.6 (#1081) Merge bdy halo stencils (#1066) Enable gauss3d experiment for distributed tests (#1013) Reenable MPS in CI (#1057) Don't compute RBF coefficients over whole domain to avoid non-positive definite matrices (#1077) muphys: Only write the surface level of the fluxes (#995) Update to gt4py v1.1.5 (#1072) Add missing asserts to dallclose calls (#1078) Print test durations in CI (#1058) Fix: Unconditionally exchange at end of corrector (#1074)

* main: Remove `vct_b` bindings only (#1082) Replace `pg_edgeidx_dsl` mask by multiplying with 0.0 (#1053) Replace `mask_hdiff` by multiplying with 0.0 (#1056) fix type hint in DiffusionConfig and remove Literal (#1088) muphys: graupel py2fgen bindings (#1073) Fix mypy warnings for DiffusionConfig (#1086) Add tracer advection to standalone driver [cycle 34] (#1039) Reject namelist parameters not supported (#1079) Update to gt4py v1.1.6 (#1081) Merge bdy halo stencils (#1066) Enable gauss3d experiment for distributed tests (#1013) Reenable MPS in CI (#1057) Don't compute RBF coefficients over whole domain to avoid non-positive definite matrices (#1077) muphys: Only write the surface level of the fluxes (#995) Update to gt4py v1.1.5 (#1072)

jcanton and others added 6 commits January 22, 2026 18:43

add cartesian coordinates to serialbox

46f7b43

add cartesian coordinates to tests

c021067

pre-commit

7b46f67

update serialized data names

2b1b0d4

Merge branch 'main' into test_cartesian_coords

d384330

Enable gauss3d experiment for distributed tests

7412e8a

jcanton added a commit that referenced this pull request Jan 30, 2026

undo cartesian related changes, now in #1013

0d4b0a5

msimberg added 2 commits February 6, 2026 16:36

Merge remote-tracking branch 'origin/main' into gauss3d-distributed-t…

4909048

…ests

Get cartesian coordinates for torus grids from savepoint

58a6810

msimberg changed the title ~~Gauss3d distributed tests~~ Enable gauss3d experiment for distributed tests Feb 6, 2026

msimberg added 2 commits February 9, 2026 10:00

Merge remote-tracking branch 'origin/main' into gauss3d-distributed-t…

2c663f4

…ests

Temporarily enable testdata download in CI

5f2beca

Merge remote-tracking branch 'origin/main' into gauss3d-distributed-t…

b1dee11

…ests

msimberg marked this pull request as ready for review February 12, 2026 13:34

msimberg requested review from jcanton and nfarabullini February 12, 2026 13:39

msimberg added 2 commits February 12, 2026 15:41

Fix and xfail some gauss3d tests in test_parallel_geometry.py

e5ad9df

Disable grid/testdata download in CI

c5bfb61

msimberg force-pushed the gauss3d-distributed-tests branch from 22eb1cd to c5bfb61 Compare February 12, 2026 14:41

msimberg commented Feb 26, 2026

View reviewed changes

Comment thread model/common/tests/common/grid/mpi_tests/test_parallel_geometry.py Outdated

msimberg commented Feb 26, 2026

View reviewed changes

Comment thread model/common/tests/common/grid/mpi_tests/test_parallel_geometry.py Outdated

msimberg commented Feb 26, 2026

View reviewed changes

Comment thread model/common/tests/common/grid/mpi_tests/test_parallel_geometry.py Outdated

Add domain size test to parallel geometry test

a760e3f

msimberg force-pushed the gauss3d-distributed-tests branch from b7f647b to a760e3f Compare February 26, 2026 09:15

msimberg added 2 commits February 26, 2026 10:16

Remove unused parameters

d3a0e36

Merge remote-tracking branch 'origin/main' into gauss3d-distributed-t…

783cea6

…ests

jcanton reviewed Feb 26, 2026

View reviewed changes

Comment thread model/driver/src/icon4py/model/driver/initialization_utils.py

Small refactoring of torus/icosahedron handling

1b5ebbd

jcanton reviewed Feb 26, 2026

View reviewed changes

Comment thread model/common/tests/common/grid/unit_tests/test_grid_manager.py

msimberg requested a review from jcanton February 26, 2026 13:15

jcanton reviewed Feb 26, 2026

View reviewed changes

msimberg and others added 5 commits February 26, 2026 14:28

Update model/common/tests/common/grid/mpi_tests/test_parallel_geometr…

56475fb

…y.py Co-authored-by: Jacopo Canton <jacopo.canton@gmail.com>

Update model/common/tests/common/grid/mpi_tests/test_parallel_geometr…

92050cf

…y.py Co-authored-by: Jacopo Canton <jacopo.canton@gmail.com>

Update model/common/tests/common/grid/mpi_tests/test_parallel_geometr…

2f6af27

…y.py Co-authored-by: Jacopo Canton <jacopo.canton@gmail.com>

Remove more xfails with gauss3d

102bfa5

Merge remote-tracking branch 'msimberg/gauss3d-distributed-tests' int…

1a15468

…o gauss3d-distributed-tests

jcanton approved these changes Feb 26, 2026

View reviewed changes

msimberg merged commit f6f7892 into C2SM:main Feb 26, 2026
48 checks passed

msimberg deleted the gauss3d-distributed-tests branch February 26, 2026 21:40

Conversation

msimberg commented Jan 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

msimberg commented Feb 6, 2026

Uh oh!

msimberg commented Feb 6, 2026

Uh oh!

msimberg commented Feb 9, 2026

Uh oh!

msimberg commented Feb 9, 2026

Uh oh!

edopao commented Feb 9, 2026

Uh oh!

edopao commented Feb 9, 2026

Uh oh!

msimberg commented Feb 9, 2026

Uh oh!

msimberg commented Feb 9, 2026

Uh oh!

msimberg commented Feb 12, 2026

Uh oh!

msimberg commented Feb 12, 2026

Uh oh!

msimberg commented Feb 12, 2026

Uh oh!

msimberg commented Feb 25, 2026

Uh oh!

msimberg commented Feb 25, 2026

Uh oh!

msimberg commented Feb 25, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

msimberg commented Feb 26, 2026

Uh oh!

msimberg commented Feb 26, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Feb 26, 2026

Uh oh!

jcanton left a comment

Choose a reason for hiding this comment

Uh oh!

msimberg commented Feb 26, 2026

Uh oh!

msimberg commented Feb 26, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

msimberg commented Jan 28, 2026 •

edited

Loading