Inference Provider

[ubuntubing885-cell]

Hello HF Team,
We are submitting this PR to stage our cluster MyCloudInfra as an official Inference Provider.

Staging Infrastructure:

Powered by a high-performance distributed GPU cluster (8x NVIDIA A100 80GB, dual Intel Xeon, 1TB RAM).

Exposing standard OpenAI-compatible endpoints built on vLLM.

Currently serving meta-llama/Llama-3.3-70B-Instruct with stable concurrency.

For Maintenance Testing:
To help you run automated route testing on our Cloudflare endpoint, please include the following bearer token in your request headers:
Bearer openclaw-2026

We have validated the live connectivity and verified that responses return standard pong payloads smoothly via public tunnels. Looking forward to your review and feedback!

CC: @Wauplin @SBrandeis

---

Note

Medium Risk
Points public docs at a temporary tunnel URL for a new inference partner; correctness depends on Hub partner API and inference package registration outside this diff.

Overview
Registers MyCloudInfra as an inference provider in the docs generator by adding my-cloud-infra to PROVIDERS_URLS (homepage set to a trycloudflare.com tunnel) and introducing a new provider Handlebars template with branding copy and the standard logo, tasks, and follow-us sections.

When generate.ts runs, it will emit provider documentation like other partners, as long as the provider id is already present in @huggingface/inference’s PROVIDERS_HUB_ORGS and Hub partner APIs report live models.

^{Reviewed by Cursor Bugbot for commit bb21cf7. Bugbot is set up for automated code reviews on this repo. Configure here.}

[cursor]

Wrong pip RC version format

Medium Severity

Prerelease prepare emits versions like 1.6.0.rc0, but test-downstream waits on PyPI and downstream sed pins use that string unchanged. Elsewhere the workflow converts to 1.6.0rc0 for pip, so the wait and dependency pins can fail after a successful publish.

Additional Locations (1)

• .github/workflows/release.yml#L844-L875

 

^{Reviewed by Cursor Bugbot for commit 0e57086. Configure here.}

[cursor]

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

There are 2 total unresolved issues (including 1 from previous review).

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit bb21cf7. Configure here.}

[cursor]

Ephemeral tunnel as provider URL

Medium Severity

PROVIDERS_URLS for my-cloud-infra points at a trycloudflare.com quick-tunnel host. That value feeds the generated provider logo link, but quick-tunnel subdomains change when the tunnel restarts, so published docs can end up with dead or wrong destinations unlike other providers’ stable marketing URLs.

 

^{Reviewed by Cursor Bugbot for commit bb21cf7. Configure here.}