Skip to content

fix tascomi snapshot timeout again#2171

Merged
Tian-2017 merged 5 commits intomainfrom
fix-tascomi-snapshot-timeout-agian
Mar 12, 2025
Merged

fix tascomi snapshot timeout again#2171
Tian-2017 merged 5 commits intomainfrom
fix-tascomi-snapshot-timeout-agian

Conversation

@Tian-2017
Copy link
Contributor

@Tian-2017 Tian-2017 commented Mar 12, 2025 •
edited
Loading

  • When loading the data, add a pushDownPredicate with a 60-day buffer time.
  • Reduce the number of workers to half. 12 G.X has 12 × 32 = 384G RAM, which is too much for the data size.
  • Clear the partition before writing to it

@Tian-2017 Tian-2017 requested review from a team as code owners March 12, 2025 12:19
@Tian-2017 Tian-2017 marked this pull request as draft March 12, 2025 12:32
@Tian-2017 Tian-2017 marked this pull request as ready for review March 12, 2025 12:46
@sonarqubecloud
Copy link

sonarqubecloud bot commented Mar 12, 2025

Quality Gate Passed Quality Gate passed

Issues
2 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

@Tian-2017 Tian-2017 merged commit bb32566 into main Mar 12, 2025
6 checks passed
@Tian-2017 Tian-2017 deleted the fix-tascomi-snapshot-timeout-agian branch March 12, 2025 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@timburke-hackit timburke-hackit timburke-hackit approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Tian-2017 @timburke-hackit