Skip to content

Add Google Cloud Storage (GCS) backend#33

Open
benhayes21 wants to merge 1 commit intodevelopfrom
gcp
Open

Add Google Cloud Storage (GCS) backend#33
benhayes21 wants to merge 1 commit intodevelopfrom
gcp

Conversation

@benhayes21
Copy link
Contributor

Summary

  • Add GcsStorage(BaseStorage) backend in oasis_data_manager/filestore/backends/gcs.py mirroring existing AWS S3 and Azure ABFS patterns, with full gcsfs/fsspec integration
  • Add GCS support across the codebase: config types, gs:///gcs:// URL parsing, log level control, and cache-enabled protocol registration
  • Add fake-gcs-server to docker-compose and GCS test coverage (dedicated, general, and caching tests — 31 new test cases)

Test plan

  • docker compose up -d to start fake-gcs-server alongside LocalStack and Azurite
  • pip install gcsfs google-cloud-storage
  • python -m pytest tests/filestorage/test_gcs.py -v -o "addopts=" — 2 GCS-specific tests
  • python -m pytest tests/filestorage/test_general.py -k "gcs_storage" -v -o "addopts=" — 18 generic tests against GCS
  • python -m pytest tests/filestorage/test_caching.py -k "storage_context2" -v -o "addopts=" — 11 caching tests against GCS
  • python -c "from oasis_data_manager.filestore.backends.gcs import GcsStorage; print('import ok')" — verify import

🤖 Generated with Claude Code

Add GcsStorage backend mirroring existing AWS S3 and Azure ABFS patterns,
with full support for gcsfs/fsspec, URL parsing, logging, caching, config,
and tests against fake-gcs-server emulator.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant