Skip to content

[SPARK-55301][SS] Re-enable all dimension in OfflineStateRepartitionIntegrationSuites#54181

Draft
zifeif2 wants to merge 1 commit intoapache:masterfrom
zifeif2:move-repartition-suite
Draft

[SPARK-55301][SS] Re-enable all dimension in OfflineStateRepartitionIntegrationSuites#54181
zifeif2 wants to merge 1 commit intoapache:masterfrom
zifeif2:move-repartition-suite

Conversation

@zifeif2
Copy link
Contributor

@zifeif2 zifeif2 commented Feb 6, 2026

What changes were proposed in this pull request?

This PR re-enable all dimensions in OfflineStateRepartitionIntegrationSuites (encoding type and enableChangelogCheckpoint), and adds the @SlowSQLTest tag to all offline state repartition integration test suites, moving them from the sql-other CI job to the sql slow-tests CI job.
Test suites tagged with @SlowSQLTest:

  • OfflineStateRepartitionCkptV1IntegrationSuite
  • OfflineStateRepartitionCkptV2IntegrationSuite
  • OfflineStateRepartitionJoinCkptV1IntegrationSuite
  • OfflineStateRepartitionJoinCkptV2IntegrationSuite
  • OfflineStateRepartitionTransformWithStateCkptV1IntegrationSuite
  • OfflineStateRepartitionTransformWithStateCkptV2IntegrationSuite

Why are the changes needed?

The offline state repartition integration tests are long-running tests that were causing the sql-other CI job to take significantly longer than other SQL CI jobs. By moving these tests to the sql slow-tests job, we can:
Re-enable all previous test dimensions that were disabled due to CI time constraints
Better balance CI job runtimes across different SQL test jobs

CI Job Runtime
ExtendedSQLTest 1 hr 21 min
SlowSQLTest 1 hr 29 min
sql-other 1 hr 40 min (excluding enabled current integration suites)

Does this PR introduce any user-facing change?

NO

How was this patch tested?

existing tests

Was this patch authored or co-authored using generative AI tooling?

yes

@github-actions
Copy link

github-actions bot commented Feb 6, 2026

JIRA Issue Information

=== Bug SPARK-55301 ===
Summary: [SS][Repartition] Re-enable DisableChangelog and TWS encode format dimension in integration test
Assignee: None
Status: Open
Affected: ["4.1.1"]


This comment was automatically generated by GitHub Actions

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant