Skip to content

Conversation

@antonis
Copy link
Contributor

@antonis antonis commented Dec 15, 2025

📢 Type of change

  • Bugfix
  • New feature
  • Enhancement
  • Refactoring

Based on: #5470

📜 Description

This PR migrates tests that were originally created in Detox to Maestro to unify all the E2E tests.

💡 Motivation and Context

This is a followup to #4914 migrating the implementation to v7

💚 How did you test it?

CI, Manual

📝 Checklist

  • I added tests to verify changes
  • No new PII added or SDK only sends newly added PII if sendDefaultPII is enabled
  • I updated the docs if needed.
  • I updated the wizard if needed.
  • All tests passing
  • No breaking changes

🔮 Next steps

#skip-changelog

krystofwoldrich and others added 4 commits June 11, 2025 20:15
…gration

- Resolved conflicts in workflow files, keeping Maestro tests
- Updated dependency versions to match RN 0.80.2
- Merged sample app changes with new tab structure
- Kept Detox test scripts for compatibility while maintaining Maestro migration
- Updated gradle and xcode configurations
@antonis antonis added the ready-to-merge Triggers the full CI test suite label Dec 15, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Dec 15, 2025

Android (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 401.33 ms 420.54 ms 19.22 ms
Size 43.94 MiB 48.91 MiB 4.97 MiB

Baseline results on branch: capture-app-start-errors-v7

Startup times

Revision Plain With Sentry Diff
99179a4+dirty 357.38 ms 375.64 ms 18.26 ms
60d1e83+dirty 406.16 ms 422.83 ms 16.67 ms
f26d7a8+dirty 380.15 ms 407.84 ms 27.68 ms

App size

Revision Plain With Sentry Diff
99179a4+dirty 43.94 MiB 48.90 MiB 4.96 MiB
60d1e83+dirty 43.94 MiB 48.90 MiB 4.96 MiB
f26d7a8+dirty 43.94 MiB 48.90 MiB 4.96 MiB

Previous results on branch: antonis/v7-detox-to-maestro-migration

Startup times

Revision Plain With Sentry Diff
16753e9+dirty 459.78 ms 503.98 ms 44.20 ms

App size

Revision Plain With Sentry Diff
16753e9+dirty 43.94 MiB 48.90 MiB 4.96 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 15, 2025

Android (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 490.18 ms 508.02 ms 17.84 ms
Size 43.75 MiB 48.08 MiB 4.33 MiB

Baseline results on branch: capture-app-start-errors-v7

Startup times

Revision Plain With Sentry Diff
99179a4+dirty 405.13 ms 415.16 ms 10.03 ms
60d1e83+dirty 396.72 ms 390.04 ms -6.68 ms
f26d7a8+dirty 571.36 ms 637.92 ms 66.56 ms

App size

Revision Plain With Sentry Diff
99179a4+dirty 43.75 MiB 48.08 MiB 4.32 MiB
60d1e83+dirty 43.75 MiB 48.08 MiB 4.32 MiB
f26d7a8+dirty 43.75 MiB 48.08 MiB 4.32 MiB

Previous results on branch: antonis/v7-detox-to-maestro-migration

Startup times

Revision Plain With Sentry Diff
16753e9+dirty 401.16 ms 433.20 ms 32.04 ms

App size

Revision Plain With Sentry Diff
16753e9+dirty 43.75 MiB 48.08 MiB 4.32 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 15, 2025

iOS (legacy) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1225.42 ms 1226.08 ms 0.66 ms
Size 3.44 MiB 4.59 MiB 1.15 MiB

Baseline results on branch: capture-app-start-errors-v7

Startup times

Revision Plain With Sentry Diff
60d1e83+dirty 1207.79 ms 1207.35 ms -0.44 ms
99179a4+dirty 1213.96 ms 1215.34 ms 1.38 ms
f26d7a8+dirty 1209.49 ms 1207.54 ms -1.95 ms

App size

Revision Plain With Sentry Diff
60d1e83+dirty 3.41 MiB 4.67 MiB 1.26 MiB
99179a4+dirty 3.44 MiB 4.67 MiB 1.23 MiB
f26d7a8+dirty 3.44 MiB 4.67 MiB 1.23 MiB

Previous results on branch: antonis/v7-detox-to-maestro-migration

Startup times

Revision Plain With Sentry Diff
16753e9+dirty 1214.38 ms 1222.09 ms 7.71 ms

App size

Revision Plain With Sentry Diff
16753e9+dirty 3.44 MiB 4.67 MiB 1.23 MiB

@github-actions
Copy link
Contributor

github-actions bot commented Dec 15, 2025

iOS (new) Performance metrics 🚀

  Plain With Sentry Diff
Startup time 1207.83 ms 1212.93 ms 5.10 ms
Size 3.44 MiB 4.59 MiB 1.15 MiB

Baseline results on branch: capture-app-start-errors-v7

Startup times

Revision Plain With Sentry Diff
60d1e83+dirty 1201.87 ms 1204.61 ms 2.74 ms
99179a4+dirty 1210.16 ms 1213.57 ms 3.40 ms
f26d7a8+dirty 1227.33 ms 1220.67 ms -6.66 ms

App size

Revision Plain With Sentry Diff
60d1e83+dirty 3.41 MiB 4.67 MiB 1.26 MiB
99179a4+dirty 3.44 MiB 4.67 MiB 1.23 MiB
f26d7a8+dirty 3.44 MiB 4.67 MiB 1.23 MiB

Previous results on branch: antonis/v7-detox-to-maestro-migration

Startup times

Revision Plain With Sentry Diff
16753e9+dirty 1200.13 ms 1202.62 ms 2.49 ms

App size

Revision Plain With Sentry Diff
16753e9+dirty 3.44 MiB 4.67 MiB 1.23 MiB

The set-dsn scripts were moved from scripts/detox/ to scripts/ during the migration
…NewsScreen

- Add scrollUntilVisible for 'Capture message' button (might be off-screen)
- Add proper waiting and scrolling for SpaceflightNewsScreen to trigger auto-load
- Wait for 'Load More Articles' button to appear after autoLoadCount threshold
@antonis
Copy link
Contributor Author

antonis commented Dec 19, 2025

The captureReplay e2e test failures on iOS are not related with this PR that touches only the sample app E2E tests and will be handled separately in a PR from the base branch.

@antonis antonis marked this pull request as ready for review December 19, 2025 12:08
@antonis antonis changed the title chore(sample-e2e): v7: Migrate from Detox to Maestro ref(sample-e2e): v7: Migrate from Detox to Maestro Dec 19, 2025
@antonis antonis merged commit 33d1129 into capture-app-start-errors-v7 Dec 22, 2025
85 of 88 checks passed
@antonis antonis deleted the antonis/v7-detox-to-maestro-migration branch December 22, 2025 13:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-to-merge Triggers the full CI test suite

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants