Support for non-AWS S3 compatible storage with STS

[dimas-b]

There are multiple implementations of the S3 API offered by non-AWS systems.

This issue tracks adding support for that in Polaris.

Likely multiple PRs will be required.

[caushie-akamai]

Hi!

This is a much-needed feature for us. We're looking to adopt Polaris Catalog for our Lakehouse, but our deployment is on Linode (S3 Compatible Object Storage), so we're currently blocked without this support.

I’d be happy to contribute and help implement this feature. If there’s a design doc or any early thoughts from the maintainers on the preferred approach, I’d love to align with that. Otherwise, I’m happy to start drafting a proposal or open a PR once I get some guidance.

Thanks for all your work on Polaris, excited to contribute!