Skip to content

chore(ci): Run E2E tests in a per-test matrix #2398

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
phipag merged 10 commits into from
Mar 3, 2026
+67 −7
Merged

chore(ci): Run E2E tests in a per-test matrix #2398

Changes from 5 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
7522186
Setup initial test matrix for test classes.
phipag Mar 3, 2026
b212ced
Increase concurrency and move build to its own step.
phipag Mar 3, 2026
7df7ca0
Add dynamic discovery of test classes to avoid duplication between po…
phipag Mar 3, 2026
efb4672
output single-line JSON as multi-line is not supported with GITHUB_OU…
phipag Mar 3, 2026
f036821
increase degree of concurreny to max 25 (20 for e2e and 5 for e2e-gra…
phipag Mar 3, 2026
f35254b
Update .github/workflows/check-e2e.yml
phipag Mar 3, 2026
fb4157f
Address PR comments by Copilot.
phipag Mar 3, 2026
7abe0dc
Update .github/workflows/check-e2e.yml
phipag Mar 3, 2026
54a6aa9
Update .github/workflows/check-e2e.yml
phipag Mar 3, 2026
38f80bb
Fix syntax error caused by Copilot.
phipag Mar 3, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 65 additions & 7 deletions .github/workflows/check-e2e.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,21 +40,67 @@ permissions:
contents: read

jobs:
e2e:
name: End-to-end Tests (Java ${{ matrix.java }})
discover-tests:
name: Discover E2E test classes
runs-on: ubuntu-latest
outputs:
e2e-classes: ${{ steps.parse.outputs.e2e-classes }}
e2e-graal-classes: ${{ steps.parse.outputs.e2e-graal-classes }}
steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
- name: Parse test classes from POM profiles
id: parse
run: |
TEST_DIR="powertools-e2e-tests/src/test/java"
POM="powertools-e2e-tests/pom.xml"

# e2e profile uses **/*E2ET.java — find all matching test files
E2E_CLASSES=$(find "$TEST_DIR" -name '*E2ET.java' | xargs -n1 basename | sed 's/\.java$//' | sort | jq -R . | jq -sc .)
Comment thread
phipag marked this conversation as resolved.
Outdated

Comment thread
phipag marked this conversation as resolved.
Outdated
# Extract include patterns from e2e-graal profile, then match against test files
GRAAL_CLASSES=$(
awk '/<id>e2e-graal<\/id>/,/<\/profile>/' "$POM" \
| grep '<include>' \
| sed 's/.*<include>\(.*\)<\/include>.*/\1/' \
| while read -r pattern; do
filename="${pattern##*/}"
find "$TEST_DIR" -name "$filename" | xargs -n1 basename | sed 's/\.java$//'
done \
Comment thread
phipag marked this conversation as resolved.
| sort | jq -R . | jq -sc .
)

echo "e2e test classes: $E2E_CLASSES"
echo "e2e-graal test classes: $GRAAL_CLASSES"

if [ "$E2E_CLASSES" = "[]" ] || [ -z "$E2E_CLASSES" ]; then
echo "::error::No e2e test classes found — check POM includes and test directory"
exit 1
fi
if [ "$GRAAL_CLASSES" = "[]" ] || [ -z "$GRAAL_CLASSES" ]; then
echo "::error::No e2e-graal test classes found — check POM includes and test directory"
exit 1
fi

echo "e2e-classes=$E2E_CLASSES" >> "$GITHUB_OUTPUT"
echo "e2e-graal-classes=$GRAAL_CLASSES" >> "$GITHUB_OUTPUT"

e2e:
name: E2E ${{ matrix.test-class }} (Java ${{ matrix.java }})
needs: discover-tests
runs-on: ubuntu-latest
permissions:
id-token: write
environment: E2E
strategy:
fail-fast: false
max-parallel: 4
max-parallel: 20
matrix:
java:
- 11
- 17
- 21
- 25
test-class: ${{ fromJSON(needs.discover-tests.outputs.e2e-classes) }}

steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
Expand All @@ -64,6 +110,8 @@ jobs:
distribution: 'corretto'
java-version: ${{ matrix.java }}
cache: maven
- name: Build all modules
run: mvn -DskipTests -ntp install --file pom.xml
Comment thread
phipag marked this conversation as resolved.
Outdated
- name: Setup AWS credentials
uses: aws-actions/configure-aws-credentials@8df5847569e6427dd6c4fb1cf565c83acfa8afa7 # v6.0.0
with:
Expand All @@ -72,20 +120,25 @@ jobs:
- name: Run e2e test with Maven
env:
JAVA_VERSION: ${{ matrix.java }}
run: mvn -DskipTests -ntp install --file pom.xml && mvn -Pe2e -B -ntp verify --file powertools-e2e-tests/pom.xml
run: >
mvn -Pe2e -B -ntp
-Dit.test="${{ matrix.test-class }}"
verify --file powertools-e2e-tests/pom.xml

e2e-graal:
name: End-to-end GraalVM Tests (Java ${{ matrix.java }})
name: E2E GraalVM ${{ matrix.test-class }} (Java ${{ matrix.java }})
needs: discover-tests
runs-on: ubuntu-latest
permissions:
id-token: write
environment: E2E
strategy:
fail-fast: false
max-parallel: 1
max-parallel: 5
matrix:
java:
- 25
test-class: ${{ fromJSON(needs.discover-tests.outputs.e2e-graal-classes) }}

steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
Expand All @@ -95,6 +148,8 @@ jobs:
distribution: 'corretto'
java-version: ${{ matrix.java }}
cache: maven
- name: Build all modules
run: mvn -DskipTests -ntp install --file pom.xml
Comment thread
phipag marked this conversation as resolved.
Outdated
- name: Setup AWS credentials
uses: aws-actions/configure-aws-credentials@8df5847569e6427dd6c4fb1cf565c83acfa8afa7 # v6.0.0
with:
Expand All @@ -103,4 +158,7 @@ jobs:
- name: Run e2e-graal test with Maven
env:
JAVA_VERSION: ${{ matrix.java }}
run: mvn -DskipTests -ntp install --file pom.xml && mvn -Pe2e-graal -B -ntp verify --file powertools-e2e-tests/pom.xml
run: >
mvn -Pe2e-graal -B -ntp
-Dit.test="${{ matrix.test-class }}"
verify --file powertools-e2e-tests/pom.xml
Loading