Skip to content

Revert "Build: Bump gcsfs from 2026.5.0 to 2026.6.0"#3580

Merged
kevinjqliu merged 1 commit into
mainfrom
revert-3560-dependabot/uv/gcsfs-2026.6.0
Jun 29, 2026
Merged

Revert "Build: Bump gcsfs from 2026.5.0 to 2026.6.0"#3580
kevinjqliu merged 1 commit into
mainfrom
revert-3560-dependabot/uv/gcsfs-2026.6.0

Conversation

@kevinjqliu

Copy link
Copy Markdown
Contributor

Reverts #3560

Dependency bump is causing integration-test-gcs to be really slow 54m vs previous 1m
#3560 (comment)

@kevinjqliu

Copy link
Copy Markdown
Contributor Author

oh look, this PR's integration-test-gcs took 1m 34s
https://github.com/apache/iceberg-python/actions/runs/28348861808/job/83977516796?pr=3580

@kevinjqliu kevinjqliu requested review from Fokko and geruh June 29, 2026 04:40
@kevinjqliu

Copy link
Copy Markdown
Contributor Author

let me task codex to see if we can fix forward with 2026.6.0

@Fokko Fokko left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's weird, I think we can revert this for now

@kevinjqliu

Copy link
Copy Markdown
Contributor Author

Root cause looks like gcsfs 2026.6.0, specifically its experimental ExtendedGcsFileSystem control-plane path with the fake GCS server.

What changed:

  • gcsfs 2026.6.0 now passes Iceberg’s custom GCS endpoint (http://0.0.0.0:4443) into the Storage Control gRPC client. The fake server supports the GCS JSON API, but not the Storage Control gRPC API. So every bucket-type probe tries gRPC against fake-gcs-server and burns timeout/retry time.

Why it takes so long:

  • gcsfs probes bucket type for zonal/HNS support on common paths like open, simple_upload, cat_file, rm, and list/info flows. When the probe fails, it returns UNKNOWN, and UNKNOWN is intentionally not cached, so the same slow probe repeats for every operation. A simple write/read/delete test can trigger roughly five probes.

🤷

@kevinjqliu kevinjqliu merged commit f17bdd5 into main Jun 29, 2026
17 checks passed
@kevinjqliu kevinjqliu deleted the revert-3560-dependabot/uv/gcsfs-2026.6.0 branch June 29, 2026 04:55
kevinjqliu pushed a commit that referenced this pull request Jun 29, 2026
# Rationale for this change

I suggest setting a timeout for CI to allow us to identify unexpected
slowdown:
* #3580

Each job takes about:
* lint-and-unit-test: 3~5 minutes
* integration-test: ~12 minutes
* integration-test-s3, integration-test-adls, integration-test-gcs: 1
minute

## Are these changes tested?

Yes

## Are there any user-facing changes?

No
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants